alliantONE Hangfire Dashboard

ICommitProjectUpdateTo3E.Run

// Job ID: #57935
using AG.A1.Scheduler.Project.Contracts.Contracts.Project;

var commitProjectUpdateTo3E = Activate<ICommitProjectUpdateTo3E>();
await commitProjectUpdateTo3E.Run(null, null);

Parameters

CurrentCulture 
"en-US"
CurrentUICulture 
"en-US"
RecurringJobId 
"PROJECT-Commit-Project-Update-To-3E-Task"
RetryCount 
10
Time 
1694766013

State

9/15/2023 1:37:21 PM (+2m 4.404s) Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
68beae11
+44msExport to 3E - Started at 9/15/2023 1:35:17 PM
+50msFetching Studies to export
+967msFetched 22 projects to export to 3E
+985ms--------------------------------------------
+992msFetching export details for Project Id: 2055461
+1.010sPreparing request to export
+1.016sExporting to 3E started
+5.675sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 1:35:22 PM
+5.684sPreparing request for Cancelling 3E Process!
+5.704sCancelling 3E Process!
+6.396sCancel Process Result: Success
+6.402s--------------------------------------------
+6.409sFetching export details for Project Id: 2059027
+6.425sPreparing request to export
+6.432sExporting to 3E started
+7.433sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 1:35:24 PM
+7.441s--------------------------------------------
+7.447sFetching export details for Project Id: 2100326
+7.461sPreparing request to export
+7.468sExporting to 3E started
+8.039sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 1:35:25 PM
+8.063s--------------------------------------------
+8.071sFetching export details for Project Id: 2102034
+8.087sPreparing request to export
+8.106sExporting to 3E started
+8.724sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 1:35:25 PM
+8.731s--------------------------------------------
+8.737sFetching export details for Project Id: 2102036
+8.757sPreparing request to export
+8.763sExporting to 3E started
+9.451sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 1:35:26 PM
+9.459s--------------------------------------------
+9.464sFetching export details for Project Id: 2061169
+9.481sPreparing request to export
+9.486sExporting to 3E started
+10.491sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 1:35:27 PM
+10.498s--------------------------------------------
+10.504sFetching export details for Project Id: 2080043
+10.520sPreparing request to export
+10.526sExporting to 3E started
+11.462sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 1:35:28 PM
+11.474s--------------------------------------------
+11.480sFetching export details for Project Id: 2099241
+11.496sPreparing request to export
+11.504sExporting to 3E started
+12.095sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 1:35:29 PM
+12.102s--------------------------------------------
+12.108sFetching export details for Project Id: 2100475
+12.123sPreparing request to export
+12.132sExporting to 3E started
+12.703sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 1:35:29 PM
+12.711s--------------------------------------------
+12.717sFetching export details for Project Id: 2102391
+12.734sPreparing request to export
+12.741sExporting to 3E started
+13.501sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 1:35:30 PM
+13.508s--------------------------------------------
+13.515sFetching export details for Project Id: 2053145
+13.531sPreparing request to export
+13.538sExporting to 3E started
+14.664sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 1:35:31 PM
+14.671s--------------------------------------------
+14.677sFetching export details for Project Id: 2054810
+14.693sPreparing request to export
+14.699sExporting to 3E started
+15.796sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 1:35:32 PM
+15.803s--------------------------------------------
+15.809sFetching export details for Project Id: 2077677
+15.825sPreparing request to export
+15.831sExporting to 3E started
+16.780sFinished Exporting Project: 2077677. Transaction Result: Failure - 9/15/2023 1:35:33 PM
+16.786s--------------------------------------------
+16.792sFetching export details for Project Id: 2102597
+16.824sPreparing request to export
+16.831sExporting to 3E started
+17.521sFinished Exporting Project: 2102597. Transaction Result: Failure - 9/15/2023 1:35:34 PM
+17.532s--------------------------------------------
+17.538sFetching export details for Project Id: 2055919
+17.593sPreparing request to export
+17.599sExporting to 3E started
+18.758sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 1:35:35 PM
+18.765s--------------------------------------------
+18.771sFetching export details for Project Id: 2059392
+18.786sPreparing request to export
+18.792sExporting to 3E started
+19.739sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 1:35:36 PM
+19.748s--------------------------------------------
+19.754sFetching export details for Project Id: 2059516
+19.771sPreparing request to export
+19.778sExporting to 3E started
+24.329sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 1:35:41 PM
+24.336s--------------------------------------------
+24.342sFetching export details for Project Id: 2082315
+24.359sPreparing request to export
+24.364sExporting to 3E started
+2m 4.379sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+1h 53m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+10ms Scheduled

Retry attempt 10 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 1:35:04 PM

+2m 2.243s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+23ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
e7c934ec
+47msExport to 3E - Started at 9/15/2023 11:39:26 AM
+53msFetching Studies to export
+723msFetched 22 projects to export to 3E
+741ms--------------------------------------------
+748msFetching export details for Project Id: 2053145
+796msPreparing request to export
+803msExporting to 3E started
+11.580sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 11:39:37 AM
+11.587s--------------------------------------------
+11.593sFetching export details for Project Id: 2061169
+11.609sPreparing request to export
+11.615sExporting to 3E started
+14.983sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 11:39:41 AM
+14.991s--------------------------------------------
+14.996sFetching export details for Project Id: 2080043
+15.011sPreparing request to export
+15.017sExporting to 3E started
+16.421sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 11:39:42 AM
+16.428s--------------------------------------------
+16.434sFetching export details for Project Id: 2100326
+16.449sPreparing request to export
+16.454sExporting to 3E started
+18.624sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 11:39:44 AM
+18.632s--------------------------------------------
+18.639sFetching export details for Project Id: 2102034
+18.659sPreparing request to export
+18.665sExporting to 3E started
+19.404sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 11:39:45 AM
+19.414s--------------------------------------------
+19.420sFetching export details for Project Id: 2102036
+19.438sPreparing request to export
+19.445sExporting to 3E started
+20.070sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 11:39:46 AM
+20.078s--------------------------------------------
+20.084sFetching export details for Project Id: 2055461
+20.111sPreparing request to export
+20.118sExporting to 3E started
+21.621sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 11:39:47 AM
+21.627sPreparing request for Cancelling 3E Process!
+21.643sCancelling 3E Process!
+22.139sCancel Process Result: Success
+22.146s--------------------------------------------
+22.153sFetching export details for Project Id: 2082315
+22.172sPreparing request to export
+22.178sExporting to 3E started
+2m 2.209sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+1h 12m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 9 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 11:39:15 AM

+2m 7.037s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
e7c934ec
+26msExport to 3E - Started at 9/15/2023 10:24:52 AM
+32msFetching Studies to export
+124msFetched 22 projects to export to 3E
+140ms--------------------------------------------
+147msFetching export details for Project Id: 2053145
+163msPreparing request to export
+169msExporting to 3E started
+4.191sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 10:24:56 AM
+4.199s--------------------------------------------
+4.220sFetching export details for Project Id: 2061169
+4.239sPreparing request to export
+4.246sExporting to 3E started
+4.994sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 10:24:57 AM
+5.001s--------------------------------------------
+5.008sFetching export details for Project Id: 2080043
+5.030sPreparing request to export
+5.037sExporting to 3E started
+5.956sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 10:24:58 AM
+5.969s--------------------------------------------
+5.976sFetching export details for Project Id: 2099241
+5.994sPreparing request to export
+6sExporting to 3E started
+8.013sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 10:25:00 AM
+8.020s--------------------------------------------
+8.028sFetching export details for Project Id: 2100475
+8.045sPreparing request to export
+8.052sExporting to 3E started
+8.894sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 10:25:01 AM
+8.901s--------------------------------------------
+8.914sFetching export details for Project Id: 2102391
+8.936sPreparing request to export
+8.946sExporting to 3E started
+9.577sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 10:25:02 AM
+9.589s--------------------------------------------
+9.596sFetching export details for Project Id: 2055919
+9.612sPreparing request to export
+9.619sExporting to 3E started
+10.885sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 10:25:03 AM
+10.893s--------------------------------------------
+10.898sFetching export details for Project Id: 2059027
+10.914sPreparing request to export
+10.921sExporting to 3E started
+12.049sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 10:25:04 AM
+12.057s--------------------------------------------
+12.063sFetching export details for Project Id: 2088491
+12.086sPreparing request to export
+12.093sExporting to 3E started
+13.268sFinished Exporting Project: 2088491. Transaction Result: Failure - 9/15/2023 10:25:05 AM
+13.275s--------------------------------------------
+13.282sFetching export details for Project Id: 2100326
+13.299sPreparing request to export
+13.305sExporting to 3E started
+14.919sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 10:25:07 AM
+14.926s--------------------------------------------
+14.932sFetching export details for Project Id: 2102034
+14.949sPreparing request to export
+14.956sExporting to 3E started
+17.691sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 10:25:10 AM
+17.699s--------------------------------------------
+17.704sFetching export details for Project Id: 2102036
+17.726sPreparing request to export
+17.733sExporting to 3E started
+20.734sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 10:25:13 AM
+20.741s--------------------------------------------
+20.751sFetching export details for Project Id: 2054810
+20.770sPreparing request to export
+20.779sExporting to 3E started
+22.137sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 10:25:14 AM
+22.145s--------------------------------------------
+22.151sFetching export details for Project Id: 2059392
+22.168sPreparing request to export
+22.175sExporting to 3E started
+22.991sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 10:25:15 AM
+22.999s--------------------------------------------
+23.005sFetching export details for Project Id: 2059516
+23.024sPreparing request to export
+23.030sExporting to 3E started
+24.219sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 10:25:16 AM
+24.227s--------------------------------------------
+24.233sFetching export details for Project Id: 2077677
+24.252sPreparing request to export
+24.268sExporting to 3E started
+24.961sFinished Exporting Project: 2077677. Transaction Result: Failure - 9/15/2023 10:25:17 AM
+24.970s--------------------------------------------
+24.977sFetching export details for Project Id: 2102597
+24.993sPreparing request to export
+25sExporting to 3E started
+25.631sFinished Exporting Project: 2102597. Transaction Result: Failure - 9/15/2023 10:25:18 AM
+25.638s--------------------------------------------
+25.645sFetching export details for Project Id: 2055461
+25.670sPreparing request to export
+25.675sExporting to 3E started
+26.507sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 10:25:19 AM
+26.514sPreparing request for Cancelling 3E Process!
+26.532sCancelling 3E Process!
+26.946sCancel Process Result: Success
+26.953s--------------------------------------------
+26.960sFetching export details for Project Id: 2082315
+26.978sPreparing request to export
+26.984sExporting to 3E started
+2m 7.009sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+42m 33.986s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 8 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 10:24:50 AM

+1m 58.517s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+23ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
d2753ae9
+36msExport to 3E - Started at 9/15/2023 9:40:20 AM
+42msFetching Studies to export
+101msFetched 22 projects to export to 3E
+115ms--------------------------------------------
+122msFetching export details for Project Id: 2061169
+137msPreparing request to export
+142msExporting to 3E started
+2.818sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 9:40:22 AM
+2.825s--------------------------------------------
+2.832sFetching export details for Project Id: 2080043
+2.848sPreparing request to export
+2.855sExporting to 3E started
+5.615sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 9:40:25 AM
+5.622s--------------------------------------------
+5.628sFetching export details for Project Id: 2099241
+5.644sPreparing request to export
+5.650sExporting to 3E started
+9.157sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 9:40:29 AM
+9.164s--------------------------------------------
+9.170sFetching export details for Project Id: 2100475
+9.187sPreparing request to export
+9.193sExporting to 3E started
+12.478sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 9:40:32 AM
+12.488s--------------------------------------------
+12.494sFetching export details for Project Id: 2102391
+12.509sPreparing request to export
+12.515sExporting to 3E started
+13.987sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 9:40:34 AM
+13.993s--------------------------------------------
+13.999sFetching export details for Project Id: 2055461
+14.018sPreparing request to export
+14.024sExporting to 3E started
+16.918sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 9:40:36 AM
+16.925sPreparing request for Cancelling 3E Process!
+16.940sCancelling 3E Process!
+18.416sCancel Process Result: Success
+18.432s--------------------------------------------
+18.441sFetching export details for Project Id: 2082315
+18.462sPreparing request to export
+18.471sExporting to 3E started
+1m 58.501sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+24m 18.484s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 7 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 9:40:12 AM

+12m 43.327s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
2bb63446
+25msExport to 3E - Started at 9/15/2023 9:03:18 AM
+32msFetching Studies to export
+85msFetched 23 projects to export to 3E
+100ms--------------------------------------------
+107msFetching export details for Project Id: 2055919
+121msPreparing request to export
+127msExporting to 3E started
+27.607sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 9:03:45 AM
+27.620s--------------------------------------------
+27.626sFetching export details for Project Id: 2059027
+27.644sPreparing request to export
+27.650sExporting to 3E started
+47.906sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 9:04:06 AM
+47.914s--------------------------------------------
+47.920sFetching export details for Project Id: 2077677
+47.940sPreparing request to export
+47.946sExporting to 3E started
+1m 27.825sFinished Exporting Project: 2077677. Transaction Result: Failure - 9/15/2023 9:04:46 AM
+1m 27.833s--------------------------------------------
+1m 27.840sFetching export details for Project Id: 2097172
+1m 27.882sPreparing request to export
+1m 27.895sExporting to 3E started
+2m 14.857sFinished Exporting Project: 2097172. Transaction Result: Success - 9/15/2023 9:05:33 AM
+2m 14.863sExport Success!
+2m 14.870s--------------------------------------------
+2m 14.877sFetching export details for Project Id: 2100326
+2m 14.897sPreparing request to export
+2m 14.901sExporting to 3E started
+2m 42.693sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 9:06:00 AM
+2m 42.700s--------------------------------------------
+2m 42.706sFetching export details for Project Id: 2102034
+2m 42.731sPreparing request to export
+2m 42.738sExporting to 3E started
+3m 23.123sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 9:06:41 AM
+3m 23.130s--------------------------------------------
+3m 23.138sFetching export details for Project Id: 2102036
+3m 23.169sPreparing request to export
+3m 23.177sExporting to 3E started
+4m 39.640sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 9:07:57 AM
+4m 39.648s--------------------------------------------
+4m 39.656sFetching export details for Project Id: 2053145
+4m 39.714sPreparing request to export
+4m 39.722sExporting to 3E started
+5m 38.958sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 9:08:57 AM
+5m 38.964s--------------------------------------------
+5m 38.972sFetching export details for Project Id: 2054810
+5m 38.990sPreparing request to export
+5m 38.997sExporting to 3E started
+6m 17.976sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 9:09:36 AM
+6m 17.985s--------------------------------------------
+6m 17.991sFetching export details for Project Id: 2055461
+6m 18.011sPreparing request to export
+6m 18.017sExporting to 3E started
+7m 20.175sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 9:10:38 AM
+7m 20.189sPreparing request for Cancelling 3E Process!
+7m 20.209sCancelling 3E Process!
+7m 28.429sCancel Process Result: Success
+7m 28.437s--------------------------------------------
+7m 28.443sFetching export details for Project Id: 2061169
+7m 28.465sPreparing request to export
+7m 28.472sExporting to 3E started
+9m 6.721sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 9:12:24 AM
+9m 6.727s--------------------------------------------
+9m 6.737sFetching export details for Project Id: 2080043
+9m 6.754sPreparing request to export
+9m 6.763sExporting to 3E started
+9m 28.453sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 9:12:46 AM
+9m 28.461s--------------------------------------------
+9m 28.468sFetching export details for Project Id: 2088491
+9m 28.484sPreparing request to export
+9m 28.490sExporting to 3E started
+9m 38.705sFinished Exporting Project: 2088491. Transaction Result: Failure - 9/15/2023 9:12:56 AM
+9m 38.712s--------------------------------------------
+9m 38.718sFetching export details for Project Id: 2099241
+9m 38.736sPreparing request to export
+9m 38.743sExporting to 3E started
+9m 49.431sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 9:13:07 AM
+9m 49.438s--------------------------------------------
+9m 49.444sFetching export details for Project Id: 2100475
+9m 49.462sPreparing request to export
+9m 49.469sExporting to 3E started
+10m 1.586sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 9:13:19 AM
+10m 1.594s--------------------------------------------
+10m 1.600sFetching export details for Project Id: 2102391
+10m 1.628sPreparing request to export
+10m 1.636sExporting to 3E started
+10m 24.046sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 9:13:42 AM
+10m 24.054s--------------------------------------------
+10m 24.061sFetching export details for Project Id: 2059392
+10m 24.077sPreparing request to export
+10m 24.083sExporting to 3E started
+10m 42.182sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 9:14:00 AM
+10m 42.190s--------------------------------------------
+10m 42.197sFetching export details for Project Id: 2059516
+10m 42.542sPreparing request to export
+10m 42.552sExporting to 3E started
+11m 3.227sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 9:14:21 AM
+11m 3.235s--------------------------------------------
+11m 3.242sFetching export details for Project Id: 2082315
+11m 3.259sPreparing request to export
+11m 3.265sExporting to 3E started
+12m 43.304sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+12m 16.520s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 6 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 9:03:17 AM

+1m 59.023s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+17ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
2bb63446
+27msExport to 3E - Started at 9/15/2023 8:49:02 AM
+33msFetching Studies to export
+115msFetched 23 projects to export to 3E
+132ms--------------------------------------------
+140msFetching export details for Project Id: 2061169
+156msPreparing request to export
+163msExporting to 3E started
+18.935sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 8:49:21 AM
+18.942s--------------------------------------------
+18.950sFetching export details for Project Id: 2082315
+18.966sPreparing request to export
+18.976sExporting to 3E started
+1m 58.999sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+5m 15.240s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 5 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
9/15/2023 8:48:48 AM

+40ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+3m 18.360s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+47ms Scheduled

Retry attempt 4 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 8:43:44 AM

+4m 42.093s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+33ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
e7c934ec
+40msExport to 3E - Started at 9/15/2023 8:35:46 AM
+49msFetching Studies to export
+148msFetched 23 projects to export to 3E
+164ms--------------------------------------------
+171msFetching export details for Project Id: 2055461
+187msPreparing request to export
+193msExporting to 3E started
+31.166sFinished Exporting Project: 2055461. Transaction Result: Interface - 9/15/2023 8:36:17 AM
+31.175sPreparing request for Cancelling 3E Process!
+31.193sCancelling 3E Process!
+39.891sCancel Process Result: Success
+39.899s--------------------------------------------
+39.906sFetching export details for Project Id: 2097172
+39.928sPreparing request to export
+39.935sExporting to 3E started
+1m 2.217sFinished Exporting Project: 2097172. Transaction Result: Success - 9/15/2023 8:36:49 AM
+1m 2.225sExport Success!
+1m 2.234s--------------------------------------------
+1m 2.244sFetching export details for Project Id: 2100326
+1m 2.263sPreparing request to export
+1m 2.270sExporting to 3E started
+1m 5.020sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 8:36:51 AM
+1m 5.027s--------------------------------------------
+1m 5.034sFetching export details for Project Id: 2102034
+1m 5.049sPreparing request to export
+1m 5.056sExporting to 3E started
+1m 7.604sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 8:36:54 AM
+1m 7.612s--------------------------------------------
+1m 7.618sFetching export details for Project Id: 2102036
+1m 7.634sPreparing request to export
+1m 7.640sExporting to 3E started
+1m 9.860sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 8:36:56 AM
+1m 9.868s--------------------------------------------
+1m 9.874sFetching export details for Project Id: 2061169
+1m 9.893sPreparing request to export
+1m 9.898sExporting to 3E started
+1m 13.639sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 8:37:00 AM
+1m 13.646s--------------------------------------------
+1m 13.655sFetching export details for Project Id: 2080043
+1m 13.671sPreparing request to export
+1m 13.677sExporting to 3E started
+1m 16.563sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 8:37:03 AM
+1m 16.572s--------------------------------------------
+1m 16.578sFetching export details for Project Id: 2099241
+1m 16.603sPreparing request to export
+1m 16.610sExporting to 3E started
+1m 18.905sFinished Exporting Project: 2099241. Transaction Result: Failure - 9/15/2023 8:37:05 AM
+1m 18.917s--------------------------------------------
+1m 18.923sFetching export details for Project Id: 2100475
+1m 18.938sPreparing request to export
+1m 18.944sExporting to 3E started
+1m 21.175sFinished Exporting Project: 2100475. Transaction Result: Failure - 9/15/2023 8:37:07 AM
+1m 21.184s--------------------------------------------
+1m 21.194sFetching export details for Project Id: 2102391
+1m 21.215sPreparing request to export
+1m 21.234sExporting to 3E started
+1m 22.420sFinished Exporting Project: 2102391. Transaction Result: Failure - 9/15/2023 8:37:09 AM
+1m 22.427s--------------------------------------------
+1m 22.434sFetching export details for Project Id: 2059392
+1m 22.449sPreparing request to export
+1m 22.455sExporting to 3E started
+1m 24.758sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 8:37:11 AM
+1m 24.767s--------------------------------------------
+1m 24.776sFetching export details for Project Id: 2059516
+1m 24.796sPreparing request to export
+1m 24.805sExporting to 3E started
+1m 28.734sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 8:37:15 AM
+1m 28.741s--------------------------------------------
+1m 28.750sFetching export details for Project Id: 2077677
+1m 28.766sPreparing request to export
+1m 28.772sExporting to 3E started
+1m 30.533sFinished Exporting Project: 2077677. Transaction Result: Failure - 9/15/2023 8:37:17 AM
+1m 30.540s--------------------------------------------
+1m 30.546sFetching export details for Project Id: 2102597
+1m 30.562sPreparing request to export
+1m 30.568sExporting to 3E started
+1m 32.785sFinished Exporting Project: 2102597. Transaction Result: Failure - 9/15/2023 8:37:19 AM
+1m 32.792s--------------------------------------------
+1m 32.798sFetching export details for Project Id: 2053145
+1m 32.816sPreparing request to export
+1m 32.822sExporting to 3E started
+1m 36.739sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 8:37:23 AM
+1m 36.746s--------------------------------------------
+1m 36.753sFetching export details for Project Id: 2054810
+1m 36.779sPreparing request to export
+1m 36.785sExporting to 3E started
+1m 39.897sFinished Exporting Project: 2054810. Transaction Result: Failure - 9/15/2023 8:37:26 AM
+1m 39.903s--------------------------------------------
+1m 39.910sFetching export details for Project Id: 2055919
+1m 39.927sPreparing request to export
+1m 39.933sExporting to 3E started
+2m 2.884sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 8:37:49 AM
+2m 2.893s--------------------------------------------
+2m 2.900sFetching export details for Project Id: 2059027
+2m 2.926sPreparing request to export
+2m 2.934sExporting to 3E started
+3m 1.845sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 8:38:48 AM
+3m 1.852s--------------------------------------------
+3m 1.858sFetching export details for Project Id: 2082315
+3m 1.883sPreparing request to export
+3m 1.891sExporting to 3E started
+4m 42.074sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+2m 5.290s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 3 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 8:35:39 AM

+3m 40.066s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
68beae11
+29msExport to 3E - Started at 9/15/2023 8:30:01 AM
+37msFetching Studies to export
+151msFetched 23 projects to export to 3E
+164ms--------------------------------------------
+171msFetching export details for Project Id: 2053145
+186msPreparing request to export
+193msExporting to 3E started
+1m 8.470sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 8:31:09 AM
+1m 8.478s--------------------------------------------
+1m 8.485sFetching export details for Project Id: 2061169
+1m 8.510sPreparing request to export
+1m 8.517sExporting to 3E started
+1m 59.951sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 8:32:01 AM
+1m 59.965s--------------------------------------------
+1m 59.978sFetching export details for Project Id: 2100326
+2m 7msPreparing request to export
+2m 15msExporting to 3E started
+3m 40.042sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+24.424s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 2 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 8:29:58 AM

+2m 35.787s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
d2753ae9
+30msExport to 3E - Started at 9/15/2023 8:27:01 AM
+36msFetching Studies to export
+123msFetched 23 projects to export to 3E
+138ms--------------------------------------------
+145msFetching export details for Project Id: 2055919
+160msPreparing request to export
+167msExporting to 3E started
+25.110sFinished Exporting Project: 2055919. Transaction Result: Failure - 9/15/2023 8:27:26 AM
+25.117s--------------------------------------------
+25.123sFetching export details for Project Id: 2059027
+25.140sPreparing request to export
+25.146sExporting to 3E started
+55.696sFinished Exporting Project: 2059027. Transaction Result: Failure - 9/15/2023 8:27:56 AM
+55.703s--------------------------------------------
+55.709sFetching export details for Project Id: 2082315
+55.725sPreparing request to export
+55.731sExporting to 3E started
+2m 35.760sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+39.706s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 1 of 10: The request was canceled due to the configured Ht…

Enqueue at:
9/15/2023 8:26:52 AM

+6m 8.243s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Scheduler.Project.Application.Features.ExportProjectUpdate.Commands.CommitProjectUpdateTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\ExportProjectUpdate\Commands\CommitProjectUpdateTo3ECommandHandler.cs:line 89
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+63ms Processing

Server:
dw1sdwk0006wl:6856
Worker:
e7c934ec
+70msExport to 3E - Started at 9/15/2023 8:20:13 AM
+77msFetching Studies to export
+135msFetched 23 projects to export to 3E
+153ms--------------------------------------------
+160msFetching export details for Project Id: 2053145
+173msPreparing request to export
+181msExporting to 3E started
+58.489sFinished Exporting Project: 2053145. Transaction Result: Failure - 9/15/2023 8:21:11 AM
+58.497s--------------------------------------------
+58.503sFetching export details for Project Id: 2061169
+58.594sPreparing request to export
+58.600sExporting to 3E started
+1m 17.361sFinished Exporting Project: 2061169. Transaction Result: Failure - 9/15/2023 8:21:30 AM
+1m 17.369s--------------------------------------------
+1m 17.376sFetching export details for Project Id: 2080043
+1m 17.391sPreparing request to export
+1m 17.398sExporting to 3E started
+1m 26.359sFinished Exporting Project: 2080043. Transaction Result: Failure - 9/15/2023 8:21:39 AM
+1m 26.365s--------------------------------------------
+1m 26.371sFetching export details for Project Id: 2097172
+1m 26.392sPreparing request to export
+1m 26.399sExporting to 3E started
+1m 49.524sFinished Exporting Project: 2097172. Transaction Result: Success - 9/15/2023 8:22:02 AM
+1m 49.531sExport Success!
+1m 49.538s--------------------------------------------
+1m 49.544sFetching export details for Project Id: 2100326
+1m 49.561sPreparing request to export
+1m 49.570sExporting to 3E started
+2m 23.251sFinished Exporting Project: 2100326. Transaction Result: Failure - 9/15/2023 8:22:36 AM
+2m 23.258s--------------------------------------------
+2m 23.267sFetching export details for Project Id: 2102034
+2m 23.282sPreparing request to export
+2m 23.290sExporting to 3E started
+3m 24.104sFinished Exporting Project: 2102034. Transaction Result: Failure - 9/15/2023 8:23:37 AM
+3m 24.119s--------------------------------------------
+3m 24.131sFetching export details for Project Id: 2102036
+3m 24.156sPreparing request to export
+3m 24.165sExporting to 3E started
+3m 50.461sFinished Exporting Project: 2102036. Transaction Result: Failure - 9/15/2023 8:24:03 AM
+3m 50.469s--------------------------------------------
+3m 50.476sFetching export details for Project Id: 2059392
+3m 50.493sPreparing request to export
+3m 50.499sExporting to 3E started
+4m 5.887sFinished Exporting Project: 2059392. Transaction Result: Failure - 9/15/2023 8:24:19 AM
+4m 5.895s--------------------------------------------
+4m 5.902sFetching export details for Project Id: 2059516
+4m 6.633sPreparing request to export
+4m 6.641sExporting to 3E started
+4m 28.186sFinished Exporting Project: 2059516. Transaction Result: Failure - 9/15/2023 8:24:41 AM
+4m 28.194s--------------------------------------------
+4m 28.202sFetching export details for Project Id: 2082315
+4m 28.230sPreparing request to export
+4m 28.237sExporting to 3E started
+6m 8.269sAn error occured: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

+7ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-project

9/15/2023 8:20:13 AM Created