alliantONE Hangfire Dashboard

ICommitProjectUpdateTo3E.Run

// Job ID: #57906
using AG.A1.Scheduler.Project.Contracts.Contracts.Project;

var commitProjectUpdateTo3E = Activate<ICommitProjectUpdateTo3E>();
await commitProjectUpdateTo3E.Run(null, null);

Parameters

CurrentCulture 
"en-US"
CurrentUICulture 
"en-US"
RecurringJobId 
"PROJECT-Commit-Project-Update-To-3E-Task"
RetryCount 
10
Time 
1694761208

State

9/15/2023 12:19:04 PM (+1m 51.066s) Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+34ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
0437bdd4
+28msExport to 3E - Started at 9/15/2023 12:17:13 PM
+34msFetching Studies to export
+122msFetched 22 projects to export to 3E
+137ms--------------------------------------------
+142msFetching export details for Project Id: 2053145
+160msPreparing request to export
+166msExporting to 3E started
+1.036sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 12:17:14 PM
+1.046s--------------------------------------------
+1.052sFetching export details for Project Id: 2061169
+1.072sPreparing request to export
+1.078sExporting to 3E started
+1.870sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 12:17:15 PM
+1.876s--------------------------------------------
+1.882sFetching export details for Project Id: 2080043
+1.898sPreparing request to export
+1.904sExporting to 3E started
+2.757sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 12:17:16 PM
+2.763s--------------------------------------------
+2.770sFetching export details for Project Id: 2100326
+2.801sPreparing request to export
+2.809sExporting to 3E started
+3.345sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 12:17:16 PM
+3.352s--------------------------------------------
+3.358sFetching export details for Project Id: 2102034
+3.379sPreparing request to export
+3.386sExporting to 3E started
+4.168sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 12:17:17 PM
+4.175s--------------------------------------------
+4.181sFetching export details for Project Id: 2102036
+4.198sPreparing request to export
+4.205sExporting to 3E started
+5.051sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 12:17:18 PM
+5.059s--------------------------------------------
+5.064sFetching export details for Project Id: 2055461
+5.083sPreparing request to export
+5.088sExporting to 3E started
+6.166sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 12:17:19 PM
+6.179sPreparing request for Cancelling 3E Process!
+6.194sCancelling 3E Process!
+7.054sCancel Process Result: Success
+7.061s--------------------------------------------
+7.068sFetching export details for Project Id: 2099241
+7.084sPreparing request to export
+7.090sExporting to 3E started
+7.663sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 12:17:21 PM
+7.676s--------------------------------------------
+7.683sFetching export details for Project Id: 2100475
+7.700sPreparing request to export
+7.706sExporting to 3E started
+8.395sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 12:17:21 PM
+8.401s--------------------------------------------
+8.408sFetching export details for Project Id: 2102391
+8.425sPreparing request to export
+8.430sExporting to 3E started
+9.084sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 12:17:22 PM
+9.092s--------------------------------------------
+9.099sFetching export details for Project Id: 2055919
+9.115sPreparing request to export
+9.121sExporting to 3E started
+10.138sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 12:17:23 PM
+10.145s--------------------------------------------
+10.151sFetching export details for Project Id: 2059027
+10.179sPreparing request to export
+10.185sExporting to 3E started
+10.971sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 12:17:24 PM
+10.978s--------------------------------------------
+10.985sFetching export details for Project Id: 2082315
+11.001sPreparing request to export
+11.007sExporting to 3E started
+1m 51.039sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+1h 53m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+70ms Scheduled

Retry attempt 10 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 12:17:11 PM

+1m 58.176s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+24ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
2bb63446
+59msExport to 3E - Started at 9/15/2023 10:21:37 AM
+67msFetching Studies to export
+270msFetched 22 projects to export to 3E
+296ms--------------------------------------------
+307msFetching export details for Project Id: 2053145
+324msPreparing request to export
+331msExporting to 3E started
+1.591sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 10:21:38 AM
+1.599s--------------------------------------------
+1.605sFetching export details for Project Id: 2054810
+1.625sPreparing request to export
+1.631sExporting to 3E started
+2.646sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 10:21:39 AM
+2.654s--------------------------------------------
+2.662sFetching export details for Project Id: 2059392
+2.678sPreparing request to export
+2.685sExporting to 3E started
+3.547sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 10:21:40 AM
+3.555s--------------------------------------------
+3.565sFetching export details for Project Id: 2059516
+3.581sPreparing request to export
+3.588sExporting to 3E started
+5.293sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 10:21:42 AM
+5.305s--------------------------------------------
+5.311sFetching export details for Project Id: 2099241
+5.328sPreparing request to export
+5.337sExporting to 3E started
+6.022sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 10:21:43 AM
+6.034s--------------------------------------------
+6.043sFetching export details for Project Id: 2100475
+6.065sPreparing request to export
+6.082sExporting to 3E started
+6.689sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 10:21:43 AM
+6.697s--------------------------------------------
+6.703sFetching export details for Project Id: 2102391
+6.720sPreparing request to export
+6.727sExporting to 3E started
+7.943sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 10:21:45 AM
+7.951s--------------------------------------------
+7.957sFetching export details for Project Id: 2061169
+7.984sPreparing request to export
+7.991sExporting to 3E started
+8.733sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 10:21:45 AM
+8.741s--------------------------------------------
+8.749sFetching export details for Project Id: 2077677
+8.765sPreparing request to export
+8.771sExporting to 3E started
+9.470sFinished Exporting Project: 2077677. Transaction Result: Failure - 9/15/2023 10:21:46 AM
+9.477s--------------------------------------------
+9.484sFetching export details for Project Id: 2088491
+9.507sPreparing request to export
+9.514sExporting to 3E started
+10.374sFinished Exporting Project: 2088491. Transaction Result: Failure - 9/15/2023 10:21:47 AM
+10.380s--------------------------------------------
+10.387sFetching export details for Project Id: 2100326
+10.404sPreparing request to export
+10.410sExporting to 3E started
+11.240sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 10:21:48 AM
+11.246s--------------------------------------------
+11.252sFetching export details for Project Id: 2102034
+11.267sPreparing request to export
+11.273sExporting to 3E started
+12.177sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 10:21:49 AM
+12.184s--------------------------------------------
+12.191sFetching export details for Project Id: 2102036
+12.207sPreparing request to export
+12.216sExporting to 3E started
+12.987sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 10:21:50 AM
+12.994s--------------------------------------------
+13sFetching export details for Project Id: 2055919
+13.017sPreparing request to export
+13.023sExporting to 3E started
+14.060sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 10:21:51 AM
+14.070s--------------------------------------------
+14.080sFetching export details for Project Id: 2059027
+14.138sPreparing request to export
+14.147sExporting to 3E started
+14.957sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 10:21:52 AM
+14.964s--------------------------------------------
+14.971sFetching export details for Project Id: 2080043
+14.991sPreparing request to export
+14.998sExporting to 3E started
+15.744sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 10:21:53 AM
+15.751s--------------------------------------------
+15.758sFetching export details for Project Id: 2102597
+15.774sPreparing request to export
+15.781sExporting to 3E started
+16.481sFinished Exporting Project: 2102597. Transaction Result: Failure - 9/15/2023 10:21:53 AM
+16.488s--------------------------------------------
+16.495sFetching export details for Project Id: 2055461
+16.511sPreparing request to export
+16.518sExporting to 3E started
+17.606sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 10:21:54 AM
+17.613sPreparing request for Cancelling 3E Process!
+17.628sCancelling 3E Process!
+18.079sCancel Process Result: Success
+18.087s--------------------------------------------
+18.094sFetching export details for Project Id: 2082315
+18.111sPreparing request to export
+18.118sExporting to 3E started
+1m 58.140sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+1h 9m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+66ms Scheduled

Retry attempt 9 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 10:21:31 AM

+2m 57.184s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
0437bdd4
+29msExport to 3E - Started at 9/15/2023 9:09:18 AM
+36msFetching Studies to export
+82msFetched 23 projects to export to 3E
+96ms--------------------------------------------
+101msFetching export details for Project Id: 2054810
+123msPreparing request to export
+129msExporting to 3E started
+1m 17.055sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 9:10:35 AM
+1m 17.065s--------------------------------------------
+1m 17.072sFetching export details for Project Id: 2059392
+1m 17.104sPreparing request to export
+1m 17.112sExporting to 3E started
+2m 57.163sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+41m 32.197s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 8 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
9/15/2023 9:09:06 AM

+40ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+24m 1.216s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 7 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
9/15/2023 8:27:42 AM

+140ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+11m 26.397s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+6ms Scheduled

Retry attempt 6 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 8:03:40 AM

+6m 34.704s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+23ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
d2753ae9
+30msExport to 3E - Started at 9/15/2023 7:45:43 AM
+36msFetching Studies to export
+169msFetched 23 projects to export to 3E
+183ms--------------------------------------------
+189msFetching export details for Project Id: 2061169
+203msPreparing request to export
+214msExporting to 3E started
+36.015sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 7:46:19 AM
+36.031s--------------------------------------------
+36.040sFetching export details for Project Id: 2077677
+36.069sPreparing request to export
+36.078sExporting to 3E started
+54.532sFinished Exporting Project: 2077677. Transaction Result: Failure - 9/15/2023 7:46:38 AM
+54.539s--------------------------------------------
+54.546sFetching export details for Project Id: 2097172
+54.890sPreparing request to export
+54.898sExporting to 3E started
+1m 10.170sFinished Exporting Project: 2097172. Transaction Result: Success - 9/15/2023 7:46:53 AM
+1m 10.177sExport Success!
+1m 10.184s--------------------------------------------
+1m 10.190sFetching export details for Project Id: 2100326
+1m 10.206sPreparing request to export
+1m 10.211sExporting to 3E started
+1m 19.538sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 7:47:03 AM
+1m 19.545s--------------------------------------------
+1m 19.550sFetching export details for Project Id: 2102034
+1m 19.565sPreparing request to export
+1m 19.571sExporting to 3E started
+1m 44.796sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 7:47:28 AM
+1m 44.803s--------------------------------------------
+1m 44.810sFetching export details for Project Id: 2102036
+1m 44.827sPreparing request to export
+1m 44.833sExporting to 3E started
+2m 7.380sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 7:47:51 AM
+2m 7.387s--------------------------------------------
+2m 7.396sFetching export details for Project Id: 2053145
+2m 7.418sPreparing request to export
+2m 7.425sExporting to 3E started
+2m 14.780sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 7:47:58 AM
+2m 14.788s--------------------------------------------
+2m 14.794sFetching export details for Project Id: 2059392
+2m 14.810sPreparing request to export
+2m 14.817sExporting to 3E started
+2m 25.465sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 7:48:09 AM
+2m 25.472s--------------------------------------------
+2m 25.477sFetching export details for Project Id: 2059516
+2m 25.499sPreparing request to export
+2m 25.506sExporting to 3E started
+2m 54.531sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 7:48:38 AM
+2m 54.538s--------------------------------------------
+2m 54.544sFetching export details for Project Id: 2080043
+2m 54.561sPreparing request to export
+2m 54.567sExporting to 3E started
+3m 1.562sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 7:48:45 AM
+3m 1.571s--------------------------------------------
+3m 1.577sFetching export details for Project Id: 2099241
+3m 1.593sPreparing request to export
+3m 1.600sExporting to 3E started
+3m 11.544sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 7:48:55 AM
+3m 11.552s--------------------------------------------
+3m 11.559sFetching export details for Project Id: 2100475
+3m 11.576sPreparing request to export
+3m 11.584sExporting to 3E started
+3m 39.058sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 7:49:22 AM
+3m 39.070s--------------------------------------------
+3m 39.078sFetching export details for Project Id: 2102391
+3m 39.103sPreparing request to export
+3m 39.111sExporting to 3E started
+3m 47.619sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 7:49:31 AM
+3m 47.626s--------------------------------------------
+3m 47.632sFetching export details for Project Id: 2054810
+3m 47.648sPreparing request to export
+3m 47.654sExporting to 3E started
+4m 12.400sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 7:49:56 AM
+4m 12.408s--------------------------------------------
+4m 12.416sFetching export details for Project Id: 2055919
+4m 12.522sPreparing request to export
+4m 12.530sExporting to 3E started
+4m 37.187sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 7:50:21 AM
+4m 37.194s--------------------------------------------
+4m 37.202sFetching export details for Project Id: 2059027
+4m 37.217sPreparing request to export
+4m 37.223sExporting to 3E started
+4m 54.613sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 7:50:38 AM
+4m 54.621s--------------------------------------------
+4m 54.628sFetching export details for Project Id: 2082315
+4m 54.644sPreparing request to export
+4m 54.653sExporting to 3E started
+6m 34.676sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+5m 9.593s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+30ms Scheduled

Retry attempt 5 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 7:45:30 AM

+17m 6.484s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+70ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
68beae11
+73msExport to 3E - Started at 9/15/2023 7:23:27 AM
+80msFetching Studies to export
+134msFetched 23 projects to export to 3E
+148ms--------------------------------------------
+156msFetching export details for Project Id: 2053145
+176msPreparing request to export
+182msExporting to 3E started
+1m 18.715sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 7:24:46 AM
+1m 18.724s--------------------------------------------
+1m 18.731sFetching export details for Project Id: 2054810
+1m 18.750sPreparing request to export
+1m 18.757sExporting to 3E started
+2m 34.228sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 7:26:01 AM
+2m 34.236s--------------------------------------------
+2m 34.242sFetching export details for Project Id: 2059027
+2m 34.272sPreparing request to export
+2m 34.279sExporting to 3E started
+2m 50.556sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 7:26:18 AM
+2m 50.563s--------------------------------------------
+2m 50.570sFetching export details for Project Id: 2097172
+2m 50.603sPreparing request to export
+2m 50.612sExporting to 3E started
+3m 38.394sFinished Exporting Project: 2097172. Transaction Result: Interface - 9/15/2023 7:27:06 AM
+3m 38.407sPreparing request for Cancelling 3E Process!
+3m 38.433sCancelling 3E Process!
+4m 22.170sCancel Process Result: Success
+4m 22.178s--------------------------------------------
+4m 22.185sFetching export details for Project Id: 2100326
+4m 22.204sPreparing request to export
+4m 22.211sExporting to 3E started
+5m 30.479sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 7:28:58 AM
+5m 30.488s--------------------------------------------
+5m 30.497sFetching export details for Project Id: 2102034
+5m 30.594sPreparing request to export
+5m 30.601sExporting to 3E started
+6m 28.184sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 7:29:55 AM
+6m 28.192s--------------------------------------------
+6m 28.201sFetching export details for Project Id: 2102036
+6m 28.233sPreparing request to export
+6m 28.240sExporting to 3E started
+7m 37.987sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 7:31:05 AM
+7m 37.997s--------------------------------------------
+7m 38.004sFetching export details for Project Id: 2055461
+7m 38.038sPreparing request to export
+7m 38.045sExporting to 3E started
+8m 33.818sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 7:32:01 AM
+8m 33.827sPreparing request for Cancelling 3E Process!
+8m 33.846sCancelling 3E Process!
+8m 53.328sCancel Process Result: Success
+8m 53.336s--------------------------------------------
+8m 53.342sFetching export details for Project Id: 2077677
+8m 53.362sPreparing request to export
+8m 53.369sExporting to 3E started
+9m 45.925sFinished Exporting Project: 2077677. Transaction Result: Failure - 9/15/2023 7:33:13 AM
+9m 45.934s--------------------------------------------
+9m 45.942sFetching export details for Project Id: 2100475
+9m 45.970sPreparing request to export
+9m 45.977sExporting to 3E started
+10m 10.976sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 7:33:38 AM
+10m 10.986s--------------------------------------------
+10m 10.993sFetching export details for Project Id: 2102391
+10m 11.013sPreparing request to export
+10m 11.021sExporting to 3E started
+11m 1.727sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 7:34:29 AM
+11m 1.735s--------------------------------------------
+11m 1.741sFetching export details for Project Id: 2061169
+11m 1.756sPreparing request to export
+11m 1.763sExporting to 3E started
+11m 44.144sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 7:35:11 AM
+11m 44.152s--------------------------------------------
+11m 44.158sFetching export details for Project Id: 2080043
+11m 44.176sPreparing request to export
+11m 44.184sExporting to 3E started
+12m 28.095sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 7:35:55 AM
+12m 28.102s--------------------------------------------
+12m 28.107sFetching export details for Project Id: 2099241
+12m 28.133sPreparing request to export
+12m 28.139sExporting to 3E started
+13m 59.495sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 7:37:27 AM
+13m 59.503s--------------------------------------------
+13m 59.509sFetching export details for Project Id: 2102597
+13m 59.526sPreparing request to export
+13m 59.532sExporting to 3E started
+14m 17.179sFinished Exporting Project: 2102597. Transaction Result: Failure - 9/15/2023 7:37:44 AM
+14m 17.186s--------------------------------------------
+14m 17.192sFetching export details for Project Id: 2055919
+14m 17.208sPreparing request to export
+14m 17.217sExporting to 3E started
+14m 26.073sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 7:37:53 AM
+14m 26.080s--------------------------------------------
+14m 26.087sFetching export details for Project Id: 2059392
+14m 26.103sPreparing request to export
+14m 26.110sExporting to 3E started
+14m 46.787sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 7:38:14 AM
+14m 46.795s--------------------------------------------
+14m 46.802sFetching export details for Project Id: 2059516
+14m 46.829sPreparing request to export
+14m 46.838sExporting to 3E started
+15m 26.414sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 7:38:54 AM
+15m 26.422s--------------------------------------------
+15m 26.431sFetching export details for Project Id: 2082315
+15m 26.456sPreparing request to export
+15m 26.462sExporting to 3E started
+17m 6.507sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+3m 29.280s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 4 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 7:23:18 AM

+9m 16.373s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+24ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
d2753ae9
+30msExport to 3E - Started at 9/15/2023 7:10:41 AM
+39msFetching Studies to export
+133msFetched 23 projects to export to 3E
+162ms--------------------------------------------
+169msFetching export details for Project Id: 2055461
+193msPreparing request to export
+200msExporting to 3E started
+1m 38.480sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 7:12:20 AM
+1m 38.489sPreparing request for Cancelling 3E Process!
+1m 38.555sCancelling 3E Process!
+1m 58.278sCancel Process Result: Success
+1m 58.285s--------------------------------------------
+1m 58.292sFetching export details for Project Id: 2099241
+1m 58.309sPreparing request to export
+1m 58.318sExporting to 3E started
+2m 43.750sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 7:13:25 AM
+2m 43.757s--------------------------------------------
+2m 43.763sFetching export details for Project Id: 2100475
+2m 43.779sPreparing request to export
+2m 43.787sExporting to 3E started
+3m 6.680sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 7:13:48 AM
+3m 6.688s--------------------------------------------
+3m 6.694sFetching export details for Project Id: 2102034
+3m 6.714sPreparing request to export
+3m 6.721sExporting to 3E started
+3m 53.988sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 7:14:35 AM
+3m 53.995s--------------------------------------------
+3m 54.003sFetching export details for Project Id: 2102036
+3m 54.036sPreparing request to export
+3m 54.046sExporting to 3E started
+5m 1.451sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 7:15:43 AM
+5m 1.457s--------------------------------------------
+5m 1.463sFetching export details for Project Id: 2061169
+5m 1.479sPreparing request to export
+5m 1.486sExporting to 3E started
+5m 16.916sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 7:15:58 AM
+5m 16.923s--------------------------------------------
+5m 16.930sFetching export details for Project Id: 2097172
+5m 16.946sPreparing request to export
+5m 16.952sExporting to 3E started
+6m 17.644sFinished Exporting Project: 2097172. Transaction Result: Success - 9/15/2023 7:16:59 AM
+6m 17.651sExport unsuccessful!
+6m 17.658s--------------------------------------------
+6m 17.664sFetching export details for Project Id: 2100326
+6m 17.683sPreparing request to export
+6m 17.690sExporting to 3E started
+7m 6.278sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 7:17:48 AM
+7m 6.286s--------------------------------------------
+7m 6.291sFetching export details for Project Id: 2102391
+7m 6.310sPreparing request to export
+7m 6.315sExporting to 3E started
+7m 12.579sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 7:17:54 AM
+7m 12.587s--------------------------------------------
+7m 12.593sFetching export details for Project Id: 2055919
+7m 12.665sPreparing request to export
+7m 12.673sExporting to 3E started
+7m 25.436sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 7:18:07 AM
+7m 25.444s--------------------------------------------
+7m 25.451sFetching export details for Project Id: 2059027
+7m 25.467sPreparing request to export
+7m 25.474sExporting to 3E started
+7m 30.068sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 7:18:12 AM
+7m 30.076s--------------------------------------------
+7m 30.084sFetching export details for Project Id: 2080043
+7m 30.101sPreparing request to export
+7m 30.113sExporting to 3E started
+7m 36.293sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 7:18:18 AM
+7m 36.302s--------------------------------------------
+7m 36.308sFetching export details for Project Id: 2082315
+7m 36.323sPreparing request to export
+7m 36.330sExporting to 3E started
+9m 16.345sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+48.463s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 3 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 7:10:33 AM

+2m 11.730s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
e7c934ec
+35msExport to 3E - Started at 9/15/2023 7:07:41 AM
+42msFetching Studies to export
+93msFetched 23 projects to export to 3E
+109ms--------------------------------------------
+116msFetching export details for Project Id: 2055919
+131msPreparing request to export
+137msExporting to 3E started
+19.485sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 7:08:01 AM
+19.492s--------------------------------------------
+19.498sFetching export details for Project Id: 2059027
+19.514sPreparing request to export
+19.521sExporting to 3E started
+31.657sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 7:08:13 AM
+31.664s--------------------------------------------
+31.670sFetching export details for Project Id: 2082315
+31.686sPreparing request to export
+31.693sExporting to 3E started
+2m 11.707sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+47.260s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 2 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 7:07:30 AM

+2m 12.836s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+27ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
68beae11
+41msExport to 3E - Started at 9/15/2023 7:04:41 AM
+48msFetching Studies to export
+97msFetched 23 projects to export to 3E
+127ms--------------------------------------------
+135msFetching export details for Project Id: 2061169
+149msPreparing request to export
+157msExporting to 3E started
+32.748sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 7:05:14 AM
+32.760s--------------------------------------------
+32.767sFetching export details for Project Id: 2082315
+32.786sPreparing request to export
+32.793sExporting to 3E started
+2m 12.814sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+20.777s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+36ms Scheduled

Retry attempt 1 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 7:04:36 AM

+4m 11.774s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
0437bdd4
+38msExport to 3E - Started at 9/15/2023 7:00:09 AM
+45msFetching Studies to export
+115msFetched 23 projects to export to 3E
+961ms--------------------------------------------
+971msFetching export details for Project Id: 2055461
+1.084sPreparing request to export
+1.090sExporting to 3E started
+32.088sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 7:00:41 AM
+32.097sPreparing request for Cancelling 3E Process!
+32.120sCancelling 3E Process!
+54.497sCancel Process Result: Success
+54.509s--------------------------------------------
+54.516sFetching export details for Project Id: 2080043
+54.542sPreparing request to export
+54.551sExporting to 3E started
+1m 39.844sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 7:01:48 AM
+1m 39.853s--------------------------------------------
+1m 39.869sFetching export details for Project Id: 2097172
+1m 39.889sPreparing request to export
+1m 39.896sExporting to 3E started
+2m 16.267sFinished Exporting Project: 2097172. Transaction Result: Interface - 9/15/2023 7:02:25 AM
+2m 16.274sPreparing request for Cancelling 3E Process!
+2m 16.296sCancelling 3E Process!
+2m 31.678sCancel Process Result: Success
+2m 31.685s--------------------------------------------
+2m 31.691sFetching export details for Project Id: 2100326
+2m 31.707sPreparing request to export
+2m 31.714sExporting to 3E started
+4m 11.740sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+7ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-project

9/15/2023 7:00:08 AM Created