alliantONE Hangfire Dashboard

ICommitProjectUpdateTo3E.Run

// Job ID: #57927
using AG.A1.Scheduler.Project.Contracts.Contracts.Project;

var commitProjectUpdateTo3E = Activate<ICommitProjectUpdateTo3E>();
await commitProjectUpdateTo3E.Run(null, null);

Parameters

CurrentCulture 
"en-US"
CurrentUICulture 
"en-US"
RecurringJobId 
"PROJECT-Commit-Project-Update-To-3E-Task"
RetryCount 
10
Time 
1694764812

State

9/15/2023 1:08:18 PM (+1m 47.413s) Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
e7c934ec
+77msExport to 3E - Started at 9/15/2023 1:06:31 PM
+94msFetching Studies to export
+307msFetched 22 projects to export to 3E
+351ms--------------------------------------------
+360msFetching export details for Project Id: 2053145
+395msPreparing request to export
+401msExporting to 3E started
+1.346sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 1:06:32 PM
+1.353s--------------------------------------------
+1.359sFetching export details for Project Id: 2061169
+1.375sPreparing request to export
+1.379sExporting to 3E started
+2.146sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 1:06:33 PM
+2.153s--------------------------------------------
+2.158sFetching export details for Project Id: 2100326
+2.175sPreparing request to export
+2.181sExporting to 3E started
+2.983sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 1:06:33 PM
+2.991s--------------------------------------------
+2.997sFetching export details for Project Id: 2102034
+3.016sPreparing request to export
+3.021sExporting to 3E started
+3.632sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 1:06:34 PM
+3.639s--------------------------------------------
+3.646sFetching export details for Project Id: 2102036
+3.679sPreparing request to export
+3.686sExporting to 3E started
+4.260sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 1:06:35 PM
+4.268s--------------------------------------------
+4.275sFetching export details for Project Id: 2054810
+4.291sPreparing request to export
+4.297sExporting to 3E started
+5.226sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 1:06:36 PM
+5.233s--------------------------------------------
+5.239sFetching export details for Project Id: 2059392
+5.256sPreparing request to export
+5.263sExporting to 3E started
+6.136sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 1:06:37 PM
+6.142s--------------------------------------------
+6.148sFetching export details for Project Id: 2059516
+6.166sPreparing request to export
+6.173sExporting to 3E started
+7.261sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 1:06:38 PM
+7.268s--------------------------------------------
+7.274sFetching export details for Project Id: 2082315
+7.290sPreparing request to export
+7.296sExporting to 3E started
+1m 47.327sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+1h 50m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 10 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 1:06:21 PM

+2m 420ms Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
e7c934ec
+27msExport to 3E - Started at 9/15/2023 11:14:24 AM
+34msFetching Studies to export
+185msFetched 22 projects to export to 3E
+203ms--------------------------------------------
+210msFetching export details for Project Id: 2054810
+226msPreparing request to export
+233msExporting to 3E started
+5.763sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 11:14:30 AM
+5.769s--------------------------------------------
+5.775sFetching export details for Project Id: 2059392
+5.790sPreparing request to export
+5.796sExporting to 3E started
+7.037sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 11:14:31 AM
+7.043s--------------------------------------------
+7.049sFetching export details for Project Id: 2059516
+7.088sPreparing request to export
+7.094sExporting to 3E started
+8.419sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 11:14:33 AM
+8.426s--------------------------------------------
+8.434sFetching export details for Project Id: 2080043
+8.452sPreparing request to export
+8.458sExporting to 3E started
+9.401sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 11:14:34 AM
+9.409s--------------------------------------------
+9.414sFetching export details for Project Id: 2101560
+9.430sPreparing request to export
+9.436sExporting to 3E started
+11.286sFinished Exporting Project: 2101560. Transaction Result: Failure - 9/15/2023 11:14:36 AM
+11.293s--------------------------------------------
+11.298sFetching export details for Project Id: 2053145
+11.314sPreparing request to export
+11.320sExporting to 3E started
+12.303sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 11:14:37 AM
+12.310s--------------------------------------------
+12.315sFetching export details for Project Id: 2061169
+12.952sPreparing request to export
+12.959sExporting to 3E started
+13.800sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 11:14:38 AM
+13.811s--------------------------------------------
+13.817sFetching export details for Project Id: 2099241
+13.832sPreparing request to export
+13.839sExporting to 3E started
+14.400sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 11:14:39 AM
+14.407s--------------------------------------------
+14.413sFetching export details for Project Id: 2100475
+14.431sPreparing request to export
+14.437sExporting to 3E started
+15.019sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 11:14:39 AM
+15.025s--------------------------------------------
+15.031sFetching export details for Project Id: 2102391
+15.047sPreparing request to export
+15.053sExporting to 3E started
+15.576sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 11:14:40 AM
+15.583s--------------------------------------------
+15.590sFetching export details for Project Id: 2055919
+15.606sPreparing request to export
+15.612sExporting to 3E started
+16.573sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 11:14:41 AM
+16.579s--------------------------------------------
+16.586sFetching export details for Project Id: 2059027
+16.603sPreparing request to export
+16.609sExporting to 3E started
+17.456sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 11:14:42 AM
+17.463s--------------------------------------------
+17.469sFetching export details for Project Id: 2077677
+17.483sPreparing request to export
+17.489sExporting to 3E started
+18.234sFinished Exporting Project: 2077677. Transaction Result: Failure - 9/15/2023 11:14:43 AM
+18.239s--------------------------------------------
+18.246sFetching export details for Project Id: 2102597
+18.262sPreparing request to export
+18.268sExporting to 3E started
+18.771sFinished Exporting Project: 2102597. Transaction Result: Failure - 9/15/2023 11:14:43 AM
+18.779s--------------------------------------------
+18.792sFetching export details for Project Id: 2055461
+18.813sPreparing request to export
+18.819sExporting to 3E started
+19.890sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 11:14:44 AM
+19.898sPreparing request for Cancelling 3E Process!
+19.915sCancelling 3E Process!
+20.332sCancel Process Result: Success
+20.338s--------------------------------------------
+20.344sFetching export details for Project Id: 2082315
+20.361sPreparing request to export
+20.368sExporting to 3E started
+2m 386msAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+1h 10m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 9 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
9/15/2023 11:14:10 AM

+30ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+41m 4.847s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 8 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 10:03:42 AM

+7m 12.720s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
d2753ae9
+30msExport to 3E - Started at 9/15/2023 9:15:33 AM
+36msFetching Studies to export
+73msFetched 23 projects to export to 3E
+86ms--------------------------------------------
+94msFetching export details for Project Id: 2055461
+111msPreparing request to export
+118msExporting to 3E started
+34.798sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 9:16:08 AM
+34.814sPreparing request for Cancelling 3E Process!
+34.828sCancelling 3E Process!
+50.138sCancel Process Result: Success
+50.147s--------------------------------------------
+50.154sFetching export details for Project Id: 2077677
+50.179sPreparing request to export
+50.186sExporting to 3E started
+1m 710msFinished Exporting Project: 2077677. Transaction Result: Failure - 9/15/2023 9:16:34 AM
+1m 718ms--------------------------------------------
+1m 723msFetching export details for Project Id: 2097172
+1m 741msPreparing request to export
+1m 747msExporting to 3E started
+1m 42.083sFinished Exporting Project: 2097172. Transaction Result: Success - 9/15/2023 9:17:15 AM
+1m 42.090sExport Success!
+1m 42.098s--------------------------------------------
+1m 42.104sFetching export details for Project Id: 2100326
+1m 42.120sPreparing request to export
+1m 42.126sExporting to 3E started
+2m 10.113sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 9:17:43 AM
+2m 10.122s--------------------------------------------
+2m 10.130sFetching export details for Project Id: 2102034
+2m 10.151sPreparing request to export
+2m 10.157sExporting to 3E started
+3m 1.851sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 9:18:35 AM
+3m 1.858s--------------------------------------------
+3m 1.865sFetching export details for Project Id: 2102036
+3m 1.881sPreparing request to export
+3m 1.887sExporting to 3E started
+4m 4.008sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 9:19:37 AM
+4m 4.015s--------------------------------------------
+4m 4.021sFetching export details for Project Id: 2055919
+4m 4.037sPreparing request to export
+4m 4.043sExporting to 3E started
+4m 25.970sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 9:19:59 AM
+4m 25.976s--------------------------------------------
+4m 25.983sFetching export details for Project Id: 2059027
+4m 26.001sPreparing request to export
+4m 26.009sExporting to 3E started
+4m 40.605sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 9:20:14 AM
+4m 40.612s--------------------------------------------
+4m 40.625sFetching export details for Project Id: 2099241
+4m 40.647sPreparing request to export
+4m 40.654sExporting to 3E started
+4m 55.664sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 9:20:29 AM
+4m 55.680s--------------------------------------------
+4m 55.686sFetching export details for Project Id: 2100475
+4m 55.709sPreparing request to export
+4m 55.714sExporting to 3E started
+4m 59.693sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 9:20:33 AM
+4m 59.700s--------------------------------------------
+4m 59.705sFetching export details for Project Id: 2102391
+4m 59.721sPreparing request to export
+4m 59.726sExporting to 3E started
+5m 3.534sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 9:20:37 AM
+5m 3.540s--------------------------------------------
+5m 3.546sFetching export details for Project Id: 2053145
+5m 3.573sPreparing request to export
+5m 3.579sExporting to 3E started
+5m 8.064sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 9:20:41 AM
+5m 8.071s--------------------------------------------
+5m 8.077sFetching export details for Project Id: 2054810
+5m 8.142sPreparing request to export
+5m 8.150sExporting to 3E started
+5m 15.908sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 9:20:49 AM
+5m 15.916s--------------------------------------------
+5m 15.921sFetching export details for Project Id: 2059392
+5m 15.936sPreparing request to export
+5m 15.942sExporting to 3E started
+5m 23.757sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 9:20:57 AM
+5m 23.764s--------------------------------------------
+5m 23.771sFetching export details for Project Id: 2059516
+5m 23.791sPreparing request to export
+5m 23.797sExporting to 3E started
+5m 32.553sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 9:21:06 AM
+5m 32.562s--------------------------------------------
+5m 32.568sFetching export details for Project Id: 2082315
+5m 32.662sPreparing request to export
+5m 32.670sExporting to 3E started
+7m 12.703sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+22m 30.634s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 7 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 9:15:29 AM

+5m 543ms Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+17ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
68beae11
+26msExport to 3E - Started at 9/15/2023 8:48:02 AM
+32msFetching Studies to export
+66msFetched 23 projects to export to 3E
+80ms--------------------------------------------
+85msFetching export details for Project Id: 2053145
+100msPreparing request to export
+107msExporting to 3E started
+8.159sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 8:48:10 AM
+8.166s--------------------------------------------
+8.172sFetching export details for Project Id: 2061169
+8.189sPreparing request to export
+8.196sExporting to 3E started
+33.626sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 8:48:36 AM
+33.634s--------------------------------------------
+33.643sFetching export details for Project Id: 2080043
+33.662sPreparing request to export
+33.670sExporting to 3E started
+1m 6.775sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 8:49:09 AM
+1m 6.783s--------------------------------------------
+1m 6.790sFetching export details for Project Id: 2100326
+1m 6.807sPreparing request to export
+1m 6.813sExporting to 3E started
+1m 29.746sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 8:49:32 AM
+1m 29.754s--------------------------------------------
+1m 29.760sFetching export details for Project Id: 2102034
+1m 29.782sPreparing request to export
+1m 29.791sExporting to 3E started
+2m 8.480sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 8:50:11 AM
+2m 8.488s--------------------------------------------
+2m 8.495sFetching export details for Project Id: 2102036
+2m 8.532sPreparing request to export
+2m 8.538sExporting to 3E started
+2m 26.155sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 8:50:28 AM
+2m 26.163s--------------------------------------------
+2m 26.169sFetching export details for Project Id: 2054810
+2m 26.257sPreparing request to export
+2m 26.272sExporting to 3E started
+2m 39.756sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 8:50:42 AM
+2m 39.763s--------------------------------------------
+2m 39.770sFetching export details for Project Id: 2059392
+2m 39.786sPreparing request to export
+2m 39.793sExporting to 3E started
+2m 48.733sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 8:50:51 AM
+2m 48.740s--------------------------------------------
+2m 48.747sFetching export details for Project Id: 2059516
+2m 48.763sPreparing request to export
+2m 48.770sExporting to 3E started
+3m 20.442sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 8:51:23 AM
+3m 20.449s--------------------------------------------
+3m 20.456sFetching export details for Project Id: 2082315
+3m 20.472sPreparing request to export
+3m 20.479sExporting to 3E started
+5m 512msAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+11m 42.573s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 6 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 8:47:59 AM

+3m 3.400s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+36ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
0437bdd4
+29msExport to 3E - Started at 9/15/2023 8:33:16 AM
+35msFetching Studies to export
+129msFetched 23 projects to export to 3E
+150ms--------------------------------------------
+157msFetching export details for Project Id: 2055461
+171msPreparing request to export
+179msExporting to 3E started
+37.890sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 8:33:54 AM
+37.899sPreparing request for Cancelling 3E Process!
+37.926sCancelling 3E Process!
+1m 23.290sCancel Process Result: Success
+1m 23.300s--------------------------------------------
+1m 23.309sFetching export details for Project Id: 2097172
+1m 23.339sPreparing request to export
+1m 23.348sExporting to 3E started
+3m 3.372sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+5m 184ms Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+6ms Scheduled

Retry attempt 5 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
9/15/2023 8:33:12 AM

+37ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+3m 12.117s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+40ms Scheduled

Retry attempt 4 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 8:28:08 AM

+7m 18.396s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
d2753ae9
+23msExport to 3E - Started at 9/15/2023 8:17:45 AM
+29msFetching Studies to export
+258msFetched 23 projects to export to 3E
+278ms--------------------------------------------
+284msFetching export details for Project Id: 2055461
+316msPreparing request to export
+322msExporting to 3E started
+28.710sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 8:18:14 AM
+28.722sPreparing request for Cancelling 3E Process!
+28.738sCancelling 3E Process!
+40.276sCancel Process Result: Success
+40.283s--------------------------------------------
+40.290sFetching export details for Project Id: 2097172
+40.319sPreparing request to export
+40.329sExporting to 3E started
+1m 39.612sFinished Exporting Project: 2097172. Transaction Result: Success - 9/15/2023 8:19:25 AM
+1m 39.619sExport Success!
+1m 39.625s--------------------------------------------
+1m 39.631sFetching export details for Project Id: 2100326
+1m 39.653sPreparing request to export
+1m 39.659sExporting to 3E started
+1m 59.103sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 8:19:44 AM
+1m 59.112s--------------------------------------------
+1m 59.119sFetching export details for Project Id: 2102034
+1m 59.141sPreparing request to export
+1m 59.148sExporting to 3E started
+3m 20.221sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 8:21:05 AM
+3m 20.229s--------------------------------------------
+3m 20.236sFetching export details for Project Id: 2102036
+3m 20.262sPreparing request to export
+3m 20.269sExporting to 3E started
+3m 44.120sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 8:21:29 AM
+3m 44.129s--------------------------------------------
+3m 44.135sFetching export details for Project Id: 2054810
+3m 44.162sPreparing request to export
+3m 44.168sExporting to 3E started
+3m 53.943sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 8:21:39 AM
+3m 53.950s--------------------------------------------
+3m 53.956sFetching export details for Project Id: 2059392
+3m 53.972sPreparing request to export
+3m 53.979sExporting to 3E started
+4m 16.492sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 8:22:02 AM
+4m 16.500s--------------------------------------------
+4m 16.508sFetching export details for Project Id: 2059516
+4m 16.529sPreparing request to export
+4m 16.545sExporting to 3E started
+5m 38.084sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 8:23:23 AM
+5m 38.089s--------------------------------------------
+5m 38.096sFetching export details for Project Id: 2082315
+5m 38.113sPreparing request to export
+5m 38.120sExporting to 3E started
+7m 18.364sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+2m 7.274s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 3 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 8:17:36 AM

+3m 52.970s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
0437bdd4
+23msExport to 3E - Started at 9/15/2023 8:11:45 AM
+29msFetching Studies to export
+185msFetched 23 projects to export to 3E
+199ms--------------------------------------------
+204msFetching export details for Project Id: 2054810
+220msPreparing request to export
+226msExporting to 3E started
+1m 10.458sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 8:12:55 AM
+1m 10.465s--------------------------------------------
+1m 10.474sFetching export details for Project Id: 2059392
+1m 10.519sPreparing request to export
+1m 10.526sExporting to 3E started
+1m 51.836sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 8:13:37 AM
+1m 51.845s--------------------------------------------
+1m 51.853sFetching export details for Project Id: 2059516
+1m 51.918sPreparing request to export
+1m 51.926sExporting to 3E started
+2m 12.856sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 8:13:58 AM
+2m 12.865s--------------------------------------------
+2m 12.872sFetching export details for Project Id: 2082315
+2m 12.891sPreparing request to export
+2m 12.898sExporting to 3E started
+3m 52.946sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+32.823s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 2 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 8:11:38 AM

+5m 12.570s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+17ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
68beae11
+25msExport to 3E - Started at 9/15/2023 8:06:00 AM
+31msFetching Studies to export
+68msFetched 23 projects to export to 3E
+81ms--------------------------------------------
+89msFetching export details for Project Id: 2053145
+101msPreparing request to export
+108msExporting to 3E started
+35.460sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 8:06:35 AM
+35.466s--------------------------------------------
+35.472sFetching export details for Project Id: 2061169
+35.500sPreparing request to export
+35.507sExporting to 3E started
+58.525sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 8:06:58 AM
+58.532s--------------------------------------------
+58.538sFetching export details for Project Id: 2080043
+58.555sPreparing request to export
+58.561sExporting to 3E started
+1m 56.848sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 8:07:56 AM
+1m 56.857s--------------------------------------------
+1m 56.864sFetching export details for Project Id: 2097172
+1m 57.087sPreparing request to export
+1m 57.098sExporting to 3E started
+2m 13.252sFinished Exporting Project: 2097172. Transaction Result: Success - 9/15/2023 8:08:13 AM
+2m 13.258sExport Success!
+2m 13.264s--------------------------------------------
+2m 13.270sFetching export details for Project Id: 2100326
+2m 13.287sPreparing request to export
+2m 13.293sExporting to 3E started
+3m 7.579sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 8:09:07 AM
+3m 7.591s--------------------------------------------
+3m 7.599sFetching export details for Project Id: 2102034
+3m 7.621sPreparing request to export
+3m 7.627sExporting to 3E started
+3m 32.469sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 8:09:32 AM
+3m 32.476s--------------------------------------------
+3m 32.483sFetching export details for Project Id: 2102036
+3m 32.499sPreparing request to export
+3m 32.508sExporting to 3E started
+5m 12.545sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+42.890s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 1 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 8:05:47 AM

+5m 5.060s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
0437bdd4
+25msExport to 3E - Started at 9/15/2023 8:00:12 AM
+33msFetching Studies to export
+81msFetched 23 projects to export to 3E
+96ms--------------------------------------------
+108msFetching export details for Project Id: 2053145
+128msPreparing request to export
+134msExporting to 3E started
+13.454sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 8:00:25 AM
+13.461s--------------------------------------------
+13.468sFetching export details for Project Id: 2059392
+13.483sPreparing request to export
+13.489sExporting to 3E started
+33.792sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 8:00:45 AM
+33.799s--------------------------------------------
+33.805sFetching export details for Project Id: 2059516
+33.822sPreparing request to export
+33.828sExporting to 3E started
+1m 17.452sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 8:01:29 AM
+1m 17.459s--------------------------------------------
+1m 17.465sFetching export details for Project Id: 2097172
+1m 17.482sPreparing request to export
+1m 17.488sExporting to 3E started
+1m 52.652sFinished Exporting Project: 2097172. Transaction Result: Success - 9/15/2023 8:02:04 AM
+1m 52.662sExport Success!
+1m 52.669s--------------------------------------------
+1m 52.678sFetching export details for Project Id: 2100326
+1m 52.719sPreparing request to export
+1m 52.726sExporting to 3E started
+2m 13.866sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 8:02:25 AM
+2m 13.873s--------------------------------------------
+2m 13.880sFetching export details for Project Id: 2102034
+2m 13.893sPreparing request to export
+2m 13.899sExporting to 3E started
+2m 32.005sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 8:02:44 AM
+2m 32.012s--------------------------------------------
+2m 32.018sFetching export details for Project Id: 2102036
+2m 32.169sPreparing request to export
+2m 32.177sExporting to 3E started
+3m 2.418sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 8:03:14 AM
+3m 2.424s--------------------------------------------
+3m 2.430sFetching export details for Project Id: 2055461
+3m 2.444sPreparing request to export
+3m 2.451sExporting to 3E started
+3m 21.550sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 8:03:33 AM
+3m 21.556sPreparing request for Cancelling 3E Process!
+3m 21.588sCancelling 3E Process!
+3m 24.971sCancel Process Result: Success
+3m 24.979s--------------------------------------------
+3m 24.986sFetching export details for Project Id: 2082315
+3m 25.002sPreparing request to export
+3m 25.013sExporting to 3E started
+5m 5.037sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+10ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-project

9/15/2023 8:00:12 AM Created