alliantONE Hangfire Dashboard

IOfflineNumberCommitTo3E.Run

// Job ID: #131012
using AG.A1.Scheduler.Project.Contracts.Contracts.Number;

var offlineNumberCommitTo3E = Activate<IOfflineNumberCommitTo3E>();
await offlineNumberCommitTo3E.Run(null, null);

Parameters

CurrentCulture 
"en-US"
CurrentUICulture 
"en-US"
RecurringJobId 
"NUMBER-Offline-Commit-Number-To-3E-Task"
RetryCount 
10
Time 
1713178867

State

4/15/2024 3:48:19 PM (+2m 23.833s) Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 165
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+100ms Processing

Server:
dw0sdwk0004w4:7108
Worker:
708cab22
+353msOfflineNumberCommitTo3ECommandHandler - Started
+29.629sNo of records retrieved : 2
+29.646s----------------------------
+29.656sSubmission started for Number: 336545
+41.101sSubmission to 3E - Started at 4/15/2024 3:46:36 PM by Prashant Goel

+1h 53m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+107ms Scheduled

Retry attempt 10 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
4/15/2024 3:45:52 PM

+420ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.RuntimeAssembly.InternalLoad(AssemblyName assemblyName, RuntimeAssembly requestingAssembly, StackCrawlMark& stackMark, Boolean throwOnFileNotFound, AssemblyLoadContext assemblyLoadContext)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at Hangfire.Common.TypeHelper.CachedAssemblyResolver(AssemblyName assemblyName)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+1h 11m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 9 of 10: The request was canceled due to the configured Ht…

Enqueue at:
4/15/2024 1:52:33 PM

+1m 40.720s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+37ms Processing

Server:
dw0sdwk0004w4:6060
Worker:
ae91fd61
+47msOfflineNumberCommitTo3ECommandHandler - Started
+274msNo of records retrieved : 2
+282ms----------------------------
+289msSubmission started for Number: 336545
+449msSubmission to 3E - Started at 4/15/2024 12:39:58 PM by Prashant Goel
+550msCurrent item:
+558msId - 336545
+585msTriggerType - VA, TaxYear - 2018, State/Fed - FED
+594msPreparing request for submission
+605msCommitting number to 3E
+1m 40.663sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 40.679sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+40m 35.640s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+13ms Scheduled

Retry attempt 8 of 10: The request was canceled due to the configured Ht…

Enqueue at:
4/15/2024 12:39:45 PM

+1m 41.433s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+30ms Processing

Server:
dw0sdwk0004w4:6060
Worker:
c388c24a
+40msOfflineNumberCommitTo3ECommandHandler - Started
+793msNo of records retrieved : 2
+800ms----------------------------
+811msSubmission started for Number: 336545
+979msSubmission to 3E - Started at 4/15/2024 11:57:41 AM by Prashant Goel
+1.105sCurrent item:
+1.112sId - 336545
+1.135sTriggerType - VA, TaxYear - 2018, State/Fed - FED
+1.143sPreparing request for submission
+1.152sCommitting number to 3E
+1m 41.312sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 41.337sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+22m 45.860s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+44ms Scheduled

Retry attempt 7 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
4/15/2024 11:57:34 AM

+310ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.RuntimeAssembly.InternalLoad(AssemblyName assemblyName, RuntimeAssembly requestingAssembly, StackCrawlMark& stackMark, Boolean throwOnFileNotFound, AssemblyLoadContext assemblyLoadContext)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at Hangfire.Common.TypeHelper.CachedAssemblyResolver(AssemblyName assemblyName)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+13m 33.273s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+10ms Scheduled

Retry attempt 6 of 10: The request was canceled due to the configured Ht…

Enqueue at:
4/15/2024 11:34:42 AM

+1m 42.297s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 165
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+96ms Processing

Server:
dw0sdwk0004w4:6060
Worker:
ae91fd61
+103msOfflineNumberCommitTo3ECommandHandler - Started
+1.002sNo of records retrieved : 2
+1.010s----------------------------
+1.020sSubmission started for Number: 336545
+1.139sSubmission to 3E - Started at 4/15/2024 11:19:39 AM by Prashant Goel
+2.126sCurrent item:
+2.134sId - 336545
+2.195sTriggerType - VA, TaxYear - 2018, State/Fed - FED
+2.204sPreparing request for submission
+2.214sCommitting number to 3E
+1m 42.290sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 42.308sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+4m 47.700s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 5 of 10: The request was canceled due to the configured Ht…

Enqueue at:
4/15/2024 11:19:31 AM

+1m 42.723s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 165
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+30ms Processing

Server:
dw0sdwk0004w4:6060
Worker:
b9c42e53
+76msOfflineNumberCommitTo3ECommandHandler - Started
+1.536sNo of records retrieved : 2
+1.559s----------------------------
+1.565sSubmission started for Number: 336545
+2.277sSubmission to 3E - Started at 4/15/2024 11:13:10 AM by Prashant Goel
+2.419sCurrent item:
+2.428sId - 336545
+2.486sTriggerType - VA, TaxYear - 2018, State/Fed - FED
+2.500sPreparing request for submission
+2.516sCommitting number to 3E
+1m 42.654sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 42.670sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+2m 34.690s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 4 of 10: The request was canceled due to the configured Ht…

Enqueue at:
4/15/2024 11:13:01 AM

+1m 40.510s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 165
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+23ms Processing

Server:
dw0sdwk0004w4:6060
Worker:
40523560
+63msOfflineNumberCommitTo3ECommandHandler - Started
+206msNo of records retrieved : 2
+213ms----------------------------
+220msSubmission started for Number: 336545
+305msSubmission to 3E - Started at 4/15/2024 11:08:53 AM by Prashant Goel
+366msCurrent item:
+372msId - 336545
+391msTriggerType - VA, TaxYear - 2018, State/Fed - FED
+398msPreparing request for submission
+405msCommitting number to 3E
+1m 40.453sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 40.465sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+1m 3.854s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+6ms Scheduled

Retry attempt 3 of 10: The request was canceled due to the configured Ht…

Enqueue at:
4/15/2024 11:08:46 AM

+1m 41.244s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 165
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+26ms Processing

Server:
dw0sdwk0004w4:6060
Worker:
c388c24a
+40msOfflineNumberCommitTo3ECommandHandler - Started
+209msNo of records retrieved : 2
+215ms----------------------------
+221msSubmission started for Number: 336545
+620msSubmission to 3E - Started at 4/15/2024 11:06:08 AM by Prashant Goel
+1.016sCurrent item:
+1.027sId - 336545
+1.048sTriggerType - VA, TaxYear - 2018, State/Fed - FED
+1.066sPreparing request for submission
+1.076sCommitting number to 3E
+1m 41.168sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 41.188sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+49.044s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 2 of 10: The request was canceled due to the configured Ht…

Enqueue at:
4/15/2024 11:05:56 AM

+1m 41.070s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 165
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+40ms Processing

Server:
dw0sdwk0004w4:6060
Worker:
f10a8ff9
+72msOfflineNumberCommitTo3ECommandHandler - Started
+389msNo of records retrieved : 2
+396ms----------------------------
+402msSubmission started for Number: 336545
+647msSubmission to 3E - Started at 4/15/2024 11:03:38 AM by Prashant Goel
+902msCurrent item:
+909msId - 336545
+934msTriggerType - VA, TaxYear - 2018, State/Fed - FED
+941msPreparing request for submission
+948msCommitting number to 3E
+1m 41.020sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 41.032sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+49.583s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 1 of 10: The request was canceled due to the configured Ht…

Enqueue at:
4/15/2024 11:03:30 AM

+1m 40.793s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 165
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+23ms Processing

Server:
dw0sdwk0004w4:6060
Worker:
ae91fd61
+27msOfflineNumberCommitTo3ECommandHandler - Started
+242msNo of records retrieved : 2
+249ms----------------------------
+256msSubmission started for Number: 336545
+406msSubmission to 3E - Started at 4/15/2024 11:01:07 AM by Prashant Goel
+613msCurrent item:
+620msId - 336545
+649msTriggerType - VA, TaxYear - 2018, State/Fed - FED
+657msPreparing request for submission
+664msCommitting number to 3E
+1m 40.715sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 40.733sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+10ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-numbers

4/15/2024 11:01:07 AM Created