alliantONE Hangfire Dashboard

ICDTTProjectFinalCompletionNotificationTask.Run

// Job ID: #360340
using AG.A1.Scheduler.Project.Contracts.Contracts.Project;

var cDTTProjectFinalCompletionNotificationTask = Activate<ICDTTProjectFinalCompletionNotificationTask>();
await cDTTProjectFinalCompletionNotificationTask.Run(null, null);

Parameters

CurrentCulture 
"en-US"
CurrentUICulture 
"en-US"
RecurringJobId 
"CDTT-SOW-Final"
RetryCount 
10
Time 
1763784008

State

11/22/2025 8:32:02 AM (+687ms) Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000dop:6460
Worker:
a582c950
+642msCDTT ProjectCompletionNotification - Failed at 11/22/2025 8:32:02 AM

+1h 52m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 10 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/22/2025 8:32:01 AM

+270ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+30ms Processing

Server:
dw1sdwk000dop:376
Worker:
e1f5de65
+238msCDTT ProjectCompletionNotification - Failed at 11/22/2025 6:39:05 AM

+1h 10m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 9 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/22/2025 6:38:55 AM

+423ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000dop:376
Worker:
e1f5de65
+358msCDTT ProjectCompletionNotification - Failed at 11/22/2025 5:28:45 AM

+42m 47.803s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 8 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/22/2025 5:28:36 AM

+284ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk000dop:376
Worker:
3d5c3a12
+223msCDTT ProjectCompletionNotification - Failed at 11/22/2025 4:45:56 AM

+23m 46.270s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+10ms Scheduled

Retry attempt 7 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/22/2025 4:45:46 AM

+1.034s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000dop:376
Worker:
5632bc25
+965msCDTT ProjectCompletionNotification - Failed at 11/22/2025 4:22:10 AM

+11m 190ms Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 6 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/22/2025 4:22:01 AM

+477ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk000dop:376
Worker:
3d5c3a12
+171msCDTT ProjectCompletionNotification - Failed at 11/22/2025 4:11:08 AM

+6m 29.847s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 5 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/22/2025 4:10:59 AM

+953ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+13ms Processing

Server:
dw1sdwk000dop:376
Worker:
e1f5de65
+369msCDTT ProjectCompletionNotification - Failed at 11/22/2025 4:04:38 AM

+2m 684ms Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 4 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
11/22/2025 4:04:33 AM

+50ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+1m 14.967s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+6ms Scheduled

Retry attempt 3 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/22/2025 4:02:26 AM

+150ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+24ms Processing

Server:
dw1sdwk000dop:376
Worker:
e1f5de65
+96msCDTT ProjectCompletionNotification - Failed at 11/22/2025 4:01:22 AM

+44.920s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 2 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/22/2025 4:01:13 AM

+136ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000dop:376
Worker:
5632bc25
+89msCDTT ProjectCompletionNotification - Failed at 11/22/2025 4:00:36 AM

+22.664s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 1 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/22/2025 4:00:32 AM

+5.400s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+73ms Processing

Server:
dw1sdwk000dop:376
Worker:
476c311f
+5.293sCDTT ProjectCompletionNotification - Failed at 11/22/2025 4:00:14 AM

+17ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-cdtt-queue

11/22/2025 4:00:08 AM Created