IOfflineNumberCommitTo3E.Run

1/15/2025 9:40:30 PM (+31.210s) Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+127ms Processing

Server:: dw0sdwk000723:3256
Worker:: a9d374bc

+91msOfflineNumberCommitTo3ECommandHandler - Started
+1.328sNo of records retrieved : 1
+1.353s----------------------------
+1.363sSubmission started for Number: 621335
+1.575sSubmission to 3E - Started at 1/15/2025 9:40:00 PM by Sam Keegan
+1.698sCurrent item:
+1.705sProject Id: 2128221, Project Number: 313716.0003, Number Id - 621335
+1.721sTrigger Type - FN, Tax Year - 2023, State/Fed - FED
+1.727sPreparing request for submission
+1.737sCommitting number to 3E
+31.174sAn error occured: Request failed with status code InternalServerError
+31.184sAn error occured: Request failed with status code InternalServerError

+1h 51m Enqueued

Triggered by DelayedJobScheduler

Queue:: default

+6ms Scheduled

Retry attempt 10 of 10: Request failed with status code InternalServerErr…

Enqueue at:: 1/15/2025 9:39:46 PM

+29.924s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+73ms Processing

Server:: dw0sdwk000723:3256
Worker:: 4f8e94a8

+101msOfflineNumberCommitTo3ECommandHandler - Started
+924msNo of records retrieved : 1
+931ms----------------------------
+938msSubmission started for Number: 621335
+1.032sSubmission to 3E - Started at 1/15/2025 7:48:21 PM by Sam Keegan
+1.145sCurrent item:
+1.152sProject Id: 2128221, Project Number: 313716.0003, Number Id - 621335
+1.183sTrigger Type - FN, Tax Year - 2023, State/Fed - FED
+1.190sPreparing request for submission
+1.196sCommitting number to 3E
+29.795sAn error occured: Request failed with status code InternalServerError
+29.811sAn error occured: Request failed with status code InternalServerError

+1h 9m Enqueued

Triggered by DelayedJobScheduler

Queue:: default

+7ms Scheduled

Retry attempt 9 of 10: Request failed with status code InternalServerErr…

Enqueue at:: 1/15/2025 7:48:15 PM

+30.927s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:: dw0sdwk000723:3256
Worker:: 4f8e94a8

+37msOfflineNumberCommitTo3ECommandHandler - Started
+1.162sNo of records retrieved : 1
+1.171s----------------------------
+1.181sSubmission started for Number: 621335
+1.319sSubmission to 3E - Started at 1/15/2025 6:38:47 PM by Sam Keegan
+1.448sCurrent item:
+1.455sProject Id: 2128221, Project Number: 313716.0003, Number Id - 621335
+1.541sTrigger Type - FN, Tax Year - 2023, State/Fed - FED
+1.548sPreparing request for submission
+1.556sCommitting number to 3E
+30.858sAn error occured: Request failed with status code InternalServerError
+30.868sAn error occured: Request failed with status code InternalServerError

+41m 20.950s Enqueued

Triggered by DelayedJobScheduler

Queue:: default

+10ms Scheduled

Retry attempt 8 of 10: The request was canceled due to the configured Ht…

Enqueue at:: 1/15/2025 6:38:45 PM

+1m 42.046s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+77ms Processing

Server:: dw0sdwk000723:3256
Worker:: 1f68d73a

+70msOfflineNumberCommitTo3ECommandHandler - Started
+1.437sNo of records retrieved : 1
+1.450s----------------------------
+1.459sSubmission started for Number: 621335
+1.697sSubmission to 3E - Started at 1/15/2025 5:55:44 PM by Sam Keegan
+1.824sCurrent item:
+1.831sProject Id: 2128221, Project Number: 313716.0003, Number Id - 621335
+1.853sTrigger Type - FN, Tax Year - 2023, State/Fed - FED
+1.859sPreparing request for submission
+1.865sCommitting number to 3E
+1m 41.959sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 41.968sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+22m 3.107s Enqueued

Triggered by DelayedJobScheduler

Queue:: default

+6ms Scheduled

Retry attempt 7 of 10: The request was canceled due to the configured Ht…

Enqueue at:: 1/15/2025 5:55:30 PM

+1m 43.454s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:: dw0sdwk000723:3256
Worker:: 1f68d73a

+33msOfflineNumberCommitTo3ECommandHandler - Started
+1.445sNo of records retrieved : 1
+1.455s----------------------------
+1.462sSubmission started for Number: 621335
+2.527sSubmission to 3E - Started at 1/15/2025 5:31:59 PM by Sam Keegan
+3.182sCurrent item:
+3.189sProject Id: 2128221, Project Number: 313716.0003, Number Id - 621335
+3.235sTrigger Type - FN, Tax Year - 2023, State/Fed - FED
+3.241sPreparing request for submission
+3.291sCommitting number to 3E
+1m 43.350sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 43.362sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+11m 30.106s Enqueued

Triggered by DelayedJobScheduler

Queue:: default

+54ms Scheduled

Retry attempt 6 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:: 1/15/2025 5:31:54 PM

+473ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at Hangfire.Common.TypeHelper.CachedAssemblyResolver(AssemblyName assemblyName)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+6m 47.480s Enqueued

Triggered by DelayedJobScheduler

Queue:: default

+10ms Scheduled

Retry attempt 5 of 10: The request was canceled due to the configured Ht…

Enqueue at:: 1/15/2025 5:20:24 PM

+1m 42.953s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+47ms Processing

Server:: dw0sdwk000723:3256
Worker:: a9d374bc

+92msOfflineNumberCommitTo3ECommandHandler - Started
+1.256sNo of records retrieved : 1
+1.264s----------------------------
+1.270sSubmission started for Number: 621335
+1.720sSubmission to 3E - Started at 1/15/2025 5:11:57 PM by Sam Keegan
+2.501sCurrent item:
+2.507sProject Id: 2128221, Project Number: 313716.0003, Number Id - 621335
+2.845sTrigger Type - FN, Tax Year - 2023, State/Fed - FED
+2.852sPreparing request for submission
+2.859sCommitting number to 3E
+1m 42.901sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 42.920sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+2m 3.710s Enqueued

Triggered by DelayedJobScheduler

Queue:: default

+10ms Scheduled

Retry attempt 4 of 10: The request was canceled due to the configured Ht…

Enqueue at:: 1/15/2025 5:11:43 PM

+1m 41.477s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:: dw0sdwk000723:3256
Worker:: a1db6549

+26msOfflineNumberCommitTo3ECommandHandler - Started
+1.049sNo of records retrieved : 1
+1.055s----------------------------
+1.061sSubmission started for Number: 621335
+1.162sSubmission to 3E - Started at 1/15/2025 5:08:11 PM by Sam Keegan
+1.277sCurrent item:
+1.284sProject Id: 2128221, Project Number: 313716.0003, Number Id - 621335
+1.300sTrigger Type - FN, Tax Year - 2023, State/Fed - FED
+1.310sPreparing request for submission
+1.317sCommitting number to 3E
+1m 41.394sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 41.419sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+48.486s Enqueued

Triggered by DelayedJobScheduler

Queue:: default

+114ms Scheduled

Retry attempt 3 of 10: The request was canceled due to the configured Ht…

Enqueue at:: 1/15/2025 5:08:04 PM

+1m 41.540s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+26ms Processing

Server:: dw0sdwk000723:3256
Worker:: 1f68d73a

+26msOfflineNumberCommitTo3ECommandHandler - Started
+1.206sNo of records retrieved : 1
+1.213s----------------------------
+1.219sSubmission started for Number: 621335
+1.307sSubmission to 3E - Started at 1/15/2025 5:05:41 PM by Sam Keegan
+1.387sCurrent item:
+1.393sProject Id: 2128221, Project Number: 313716.0003, Number Id - 621335
+1.414sTrigger Type - FN, Tax Year - 2023, State/Fed - FED
+1.420sPreparing request for submission
+1.427sCommitting number to 3E
+1m 41.477sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 41.485sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+33.470s Enqueued

Triggered by DelayedJobScheduler

Queue:: default

+10ms Scheduled

Retry attempt 2 of 10: The request was canceled due to the configured Ht…

Enqueue at:: 1/15/2025 5:05:34 PM

+1m 41.670s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+17ms Processing

Server:: dw0sdwk000723:3256
Worker:: 4f8e94a8

+42msOfflineNumberCommitTo3ECommandHandler - Started
+1.116sNo of records retrieved : 1
+1.123s----------------------------
+1.129sSubmission started for Number: 621335
+1.214sSubmission to 3E - Started at 1/15/2025 5:03:26 PM by Sam Keegan
+1.327sCurrent item:
+1.333sProject Id: 2128221, Project Number: 313716.0003, Number Id - 621335
+1.352sTrigger Type - FN, Tax Year - 2023, State/Fed - FED
+1.373sPreparing request for submission
+1.401sCommitting number to 3E

+33.813s Enqueued

Triggered by DelayedJobScheduler

Queue:: default

+4ms Scheduled

Retry attempt 1 of 10: The request was canceled due to the configured Ht…

Enqueue at:: 1/15/2025 5:03:24 PM

+1m 41.390s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.CommitNumbersTo3E(NumberCommitInputWrapperDto numberCommitInputWrapper) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 167
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Helpers.OfflineCommitNumbersTo3EHelper.HandleRequest(CommitNumbersTo3ERequest request, PerformContext performContext, IAlliantOneApiClientController alliantOneApiClientController, IE3EWrapperApiClientController wrapperApiClientController) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Helpers\OfflineCommitNumbersTo3EHelper.cs:line 130
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 73
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+70ms Processing

Server:: dw0sdwk000723:3256
Worker:: 0fb14427

+79msOfflineNumberCommitTo3ECommandHandler - Started
+1.048sNo of records retrieved : 1
+1.055s----------------------------
+1.062sSubmission started for Number: 621335
+1.169sSubmission to 3E - Started at 1/15/2025 5:01:10 PM by Sam Keegan
+1.260sCurrent item:
+1.270sProject Id: 2128221, Project Number: 313716.0003, Number Id - 621335
+1.295sTrigger Type - FN, Tax Year - 2023, State/Fed - FED
+1.304sPreparing request for submission
+1.312sCommitting number to 3E
+1m 41.391sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
+1m 41.397sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+6ms Enqueued

Triggered by recurring job scheduler

Queue:: a1-numbers

CurrentCulture	`"en-US"`
CurrentUICulture	`"en-US"`
RecurringJobId	`"NUMBER-Offline-Commit-Number-To-3E-Task"`
RetryCount	`10`
Time	`1736960469`

Parameters

Requeue Delete State

1/15/2025 9:40:30 PM (+31.210s) Failed

System.Net.Http.HttpRequestException

+127ms Processing

+1h 51m Enqueued

+6ms Scheduled

+29.924s Failed

System.Net.Http.HttpRequestException

+73ms Processing

+1h 9m Enqueued

+7ms Scheduled

+30.927s Failed

System.Net.Http.HttpRequestException

+20ms Processing

+41m 20.950s Enqueued

+10ms Scheduled

+1m 42.046s Failed

System.Threading.Tasks.TaskCanceledException

+77ms Processing

+22m 3.107s Enqueued

+6ms Scheduled

+1m 43.454s Failed

System.Threading.Tasks.TaskCanceledException

+20ms Processing

+11m 30.106s Enqueued

+54ms Scheduled

+473ms Failed

System.IO.FileNotFoundException

+6m 47.480s Enqueued

+10ms Scheduled

+1m 42.953s Failed

System.Threading.Tasks.TaskCanceledException

+47ms Processing

+2m 3.710s Enqueued

+10ms Scheduled

+1m 41.477s Failed

System.Threading.Tasks.TaskCanceledException

+20ms Processing

+48.486s Enqueued

+114ms Scheduled

+1m 41.540s Failed

System.Threading.Tasks.TaskCanceledException

+26ms Processing

+33.470s Enqueued

+10ms Scheduled

+1m 41.670s Failed

System.Threading.Tasks.TaskCanceledException

+17ms Processing

+33.813s Enqueued

+4ms Scheduled

+1m 41.390s Failed

System.Threading.Tasks.TaskCanceledException

+70ms Processing

+6ms Enqueued

1/15/2025 5:01:09 PM Created

State