alliantONE Hangfire Dashboard

IOfflineTimeCommitTo3ECommandHandler.Run

// Job ID: #75947
using AG.A1.Scheduler.Billing.Contracts;

var offlineTimeCommitTo3ECommandHandler = Activate<IOfflineTimeCommitTo3ECommandHandler>();
await offlineTimeCommitTo3ECommandHandler.Run(null, null);

Parameters

CurrentCulture 
"en-US"
CurrentUICulture 
"en-US"
RecurringJobId 
"TMS-Sync-Offline-TimeEntries-To-3E-Task"
RetryCount 
10
Time 
1697796014

State

10/20/2023 2:32:12 PM (+284ms) Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+30ms Processing

Server:
dw1sdwk0006wl:5180
Worker:
f7307851
+37msOfflineTimeCommitTo3ECommandHandler - Started
+204msNo of records retrieved : 157

+1h 50m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 10 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/20/2023 2:32:07 PM

+427ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:5180
Worker:
70e2c3e2
+27msOfflineTimeCommitTo3ECommandHandler - Started
+351msNo of records retrieved : 157

+1h 9m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+47ms Scheduled

Retry attempt 9 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/20/2023 12:41:19 PM

+250ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+130ms Processing

Server:
dw1sdwk0006wl:5180
Worker:
f7307851
+136msOfflineTimeCommitTo3ECommandHandler - Started
+310msNo of records retrieved : 157

+41m 15.256s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 8 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/20/2023 11:31:51 AM

+1.556s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+147ms Processing

Server:
dw1sdwk0006wl:5180
Worker:
48f4326a
+155msOfflineTimeCommitTo3ECommandHandler - Started
+1.615sNo of records retrieved : 157

+24m 45.757s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+10ms Scheduled

Retry attempt 7 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/20/2023 10:50:39 AM

+570ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:5180
Worker:
b50f48c0
+30msOfflineTimeCommitTo3ECommandHandler - Started
+435msNo of records retrieved : 157

+13m 15.326s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 6 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/20/2023 10:25:54 AM

+314ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk0006wl:5180
Worker:
70e2c3e2
+31msOfflineTimeCommitTo3ECommandHandler - Started
+237msNo of records retrieved : 157

+6m 200ms Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 5 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
10/20/2023 10:12:39 AM

+40ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Billing.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Billing.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Billing.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.RuntimeAssembly.InternalLoad(AssemblyName assemblyName, RuntimeAssembly requestingAssembly, StackCrawlMark& stackMark, Boolean throwOnFileNotFound, AssemblyLoadContext assemblyLoadContext)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+2m 44.773s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 4 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/20/2023 10:06:34 AM

+406ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+24ms Processing

Server:
dw1sdwk0006wl:5180
Worker:
48f4326a
+27msOfflineTimeCommitTo3ECommandHandler - Started
+325msNo of records retrieved : 157

+1m 43.356s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 3 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/20/2023 10:03:57 AM

+1.666s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+57ms Processing

Server:
dw1sdwk0006wl:5180
Worker:
7b3e1e64
+208msOfflineTimeCommitTo3ECommandHandler - Started
+808msNo of records retrieved : 157

+1m 14.693s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 2 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/20/2023 10:02:02 AM

+416ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:5180
Worker:
70e2c3e2
+27msOfflineTimeCommitTo3ECommandHandler - Started
+319msNo of records retrieved : 157

+42.947s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+33ms Scheduled

Retry attempt 1 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/20/2023 10:00:54 AM

+974ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+33ms Processing

Server:
dw1sdwk0006wl:5180
Worker:
48f4326a
+53msOfflineTimeCommitTo3ECommandHandler - Started
+892msNo of records retrieved : 157

+10ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-billing

10/20/2023 10:00:14 AM Created