alliantONE Hangfire Dashboard

IOfflineTimeCommitTo3ECommandHandler.Run

// Job ID: #76430
using AG.A1.Scheduler.Billing.Contracts;

var offlineTimeCommitTo3ECommandHandler = Activate<IOfflineTimeCommitTo3ECommandHandler>();
await offlineTimeCommitTo3ECommandHandler.Run(null, null);

Parameters

CurrentCulture 
"en-US"
CurrentUICulture 
"en-US"
RecurringJobId 
"TMS-Sync-Offline-TimeEntries-To-3E-Task"
RetryCount 
10
Time 
1697878801

State

10/21/2023 1:35:57 PM (+1m 33.027s) Failed

An exception occurred during performance of the job.

System.NullReferenceException

Object reference not set to an instance of an object.

System.NullReferenceException: Object reference not set to an instance of an object.
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.SendBulkTimeEntriesTo3E(IEnumerable`1 timeEntries, PerformContext performContext) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 306
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 69
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
4c502b0d
+27msOfflineTimeCommitTo3ECommandHandler - Started
+233msNo of records retrieved : 157
+3.297sProcessing #: 18274181 | FeeUserId - 6659 | Client # - 304961 | Study # - 0005
+3.306sStudy Not Found
+3.313sProcessing #: 18274182 | FeeUserId - 6659 | Client # - 310711 | Study # - 0004
+3.322sStudy Not Found
+3.328sProcessing #: 18274183 | FeeUserId - 6659 | Client # - 331576 | Study # - 0002
+3.335sStudy Not Found
+3.342sProcessing #: 18274184 | FeeUserId - 6659 | Client # - 331601 | Study # - 0001
+3.350sStudy Found: #- 126257 | Timekeeper - 2 | Office - 11000
+3.356sProcessing #: 18274185 | FeeUserId - 6659 | Client # - 309663 | Study # - 0001
+3.363sStudy Found: #- 83776 | Timekeeper - 2 | Office - 11750
+3.370sProcessing #: 18274186 | FeeUserId - 6659 | Client # - 314417 | Study # - 0001
+3.377sStudy Found: #- 95009 | Timekeeper - 2 | Office - 19000
+3.384sProcessing #: 18274187 | FeeUserId - 6659 | Client # - 309413 | Study # - 0002
+3.391sStudy Found: #- 83404 | Timekeeper - 2 | Office - 00000
+3.398sProcessing #: 18274188 | FeeUserId - 6659 | Client # - 310138 | Study # - 0002
+3.406sStudy Found: #- 84512 | Timekeeper - 2 | Office - 11500
+3.414sProcessing #: 18274189 | FeeUserId - 6659 | Client # - 310809 | Study # - 0002
+3.421sStudy Found: #- 85430 | Timekeeper - 2 | Office - 13250
+3.427sProcessing #: 18274190 | FeeUserId - 6659 | Client # - 316696 | Study # - 0002
+3.448sStudy Found: #- 98842 | Timekeeper - 2 | Office - 11000
+3.464sProcessing #: 18274191 | FeeUserId - 6659 | Client # - 303641 | Study # - 0002
+3.470sStudy Found: #- 65965 | Timekeeper - 2 | Office - 18750
+3.476sProcessing #: 18274192 | FeeUserId - 6659 | Client # - 304516 | Study # - 0003
+3.483sStudy Found: #- 65592 | Timekeeper - 2 | Office - 16250
+3.489sProcessing #: 18274193 | FeeUserId - 6659 | Client # - 304516 | Study # - 0002
+3.496sStudy Found: #- 65584 | Timekeeper - 2 | Office - 16250
+3.503sProcessing #: 18274194 | FeeUserId - 6659 | Client # - 007914 | Study # - 0010
+3.510sStudy Found: #- 89415 | Timekeeper - 2 | Office - 11000
+3.517sProcessing #: 18274195 | FeeUserId - 6659 | Client # - 301137 | Study # - 0007
+3.525sStudy Found: #- 117463 | Timekeeper - 2 | Office - 12250
+3.531sProcessing #: 18274196 | FeeUserId - 6659 | Client # - 300912 | Study # - 0004
+3.538sStudy Found: #- 90097 | Timekeeper - 2 | Office - 13000
+3.544sProcessing #: 18274197 | FeeUserId - 6659 | Client # - 303815 | Study # - 0002
+3.551sStudy Found: #- 66056 | Timekeeper - 2 | Office - 13000
+3.557sProcessing #: 18274198 | FeeUserId - 6659 | Client # - 013027 | Study # - 0002
+3.565sStudy Found: #- 17262 | Timekeeper - 2 | Office - 12000
+3.572sProcessing #: 18274199 | FeeUserId - 6659 | Client # - 003362 | Study # - 0012
+3.578sStudy Found: #- 53814 | Timekeeper - 2 | Office - 12000
+3.589sProcessing #: 18274200 | FeeUserId - 6659 | Client # - 010894 | Study # - 0007
+3.603sStudy Found: #- 72451 | Timekeeper - 2 | Office - 20500
+3.610sProcessing #: 18274201 | FeeUserId - 6659 | Client # - 301924 | Study # - 0001
+3.618sStudy Found: #- 53389 | Timekeeper - 2 | Office - 11000
+3.625sProcessing #: 18274202 | FeeUserId - 6659 | Client # - 306547 | Study # - 0002
+3.632sStudy Found: #- 77595 | Timekeeper - 2 | Office - 20500
+3.638sProcessing #: 18274203 | FeeUserId - 6659 | Client # - 307683 | Study # - 0002
+3.645sStudy Found: #- 79940 | Timekeeper - 2 | Office - 21500
+3.652sProcessing #: 18274204 | FeeUserId - 6659 | Client # - 304673 | Study # - 0023
+3.658sStudy Found: #- 118872 | Timekeeper - 2 | Office - 16500
+3.667sProcessing #: 18274205 | FeeUserId - 6659 | Client # - 005836 | Study # - 0002
+3.677sStudy Found: #- 51674 | Timekeeper - 2 | Office - 17250
+3.684sProcessing #: 18274206 | FeeUserId - 6659 | Client # - 311892 | Study # - 0003
+3.691sStudy Found: #- 102920 | Timekeeper - 2 | Office - 13000
+3.698sProcessing #: 18274207 | FeeUserId - 6659 | Client # - 304549 | Study # - 0001
+3.704sStudy Found: #- 65560 | Timekeeper - 2 | Office - 18000
+3.711sProcessing #: 18274208 | FeeUserId - 6659 | Client # - 320813 | Study # - 0001
+3.720sStudy Found: #- 105143 | Timekeeper - 2 | Office - 17750
+3.727sProcessing #: 18274209 | FeeUserId - 6659 | Client # - 303960 | Study # - 0001
+3.734sStudy Found: #- 61232 | Timekeeper - 2 | Office - 13250
+3.740sProcessing #: 18274210 | FeeUserId - 6659 | Client # - 304883 | Study # - 0001
+3.747sStudy Found: #- 69841 | Timekeeper - 2 | Office - 13750
+3.753sProcessing #: 18274211 | FeeUserId - 6659 | Client # - 012355 | Study # - 0010
+3.761sStudy Found: #- 70359 | Timekeeper - 2 | Office - 11000
+3.768sProcessing #: 18274212 | FeeUserId - 6659 | Client # - 006871 | Study # - 0008
+3.775sStudy Found: #- 74316 | Timekeeper - 2 | Office - 18500
+3.782sProcessing #: 18274213 | FeeUserId - 6659 | Client # - 300980 | Study # - 0002
+3.788sStudy Found: #- 61791 | Timekeeper - 2 | Office - 20500
+3.795sProcessing #: 18274214 | FeeUserId - 6659 | Client # - 302275 | Study # - 0002
+3.816sStudy Found: #- 73530 | Timekeeper - 2 | Office - 11000
+3.822sProcessing #: 18274215 | FeeUserId - 6659 | Client # - 014593 | Study # - 0005
+3.829sStudy Found: #- 70555 | Timekeeper - 2 | Office - 13000
+3.836sProcessing #: 18274216 | FeeUserId - 6659 | Client # - 014609 | Study # - 0004
+3.847sStudy Found: #- 70159 | Timekeeper - 2 | Office - 11500
+3.853sProcessing #: 18274217 | FeeUserId - 6659 | Client # - 303043 | Study # - 0002
+3.861sStudy Found: #- 66698 | Timekeeper - 2 | Office - 11000
+3.868sProcessing #: 18274218 | FeeUserId - 6659 | Client # - 301517 | Study # - 0002
+3.875sStudy Found: #- 65742 | Timekeeper - 2 | Office - 13000
+3.882sProcessing #: 18274219 | FeeUserId - 6659 | Client # - 304223 | Study # - 0001
+3.889sStudy Found: #- 61780 | Timekeeper - 2 | Office - 19750
+3.896sProcessing #: 18274220 | FeeUserId - 6659 | Client # - 001500 | Study # - 0007
+3.903sStudy Found: #- 79243 | Timekeeper - 2 | Office - 21500
+3.911sProcessing #: 18274221 | FeeUserId - 6659 | Client # - 306420 | Study # - 0002
+3.919sStudy Found: #- 77292 | Timekeeper - 2 | Office - 13000
+3.926sProcessing #: 18274222 | FeeUserId - 6659 | Client # - 014442 | Study # - 0007
+3.933sStudy Found: #- 84263 | Timekeeper - 2 | Office - 13750
+3.940sProcessing #: 18274223 | FeeUserId - 6659 | Client # - 304988 | Study # - 0003
+3.946sStudy Found: #- 70349 | Timekeeper - 2 | Office - 14000
+3.953sProcessing #: 18274224 | FeeUserId - 6659 | Client # - 304790 | Study # - 0002
+3.960sStudy Found: #- 69390 | Timekeeper - 2 | Office - 12250
+3.967sProcessing #: 18274225 | FeeUserId - 6659 | Client # - 304362 | Study # - 0002
+3.976sStudy Found: #- 65904 | Timekeeper - 2 | Office - 16000
+3.983sProcessing #: 18274226 | FeeUserId - 6659 | Client # - 005668 | Study # - 0010
+3.990sStudy Found: #- 63719 | Timekeeper - 2 | Office - 19000
+3.996sProcessing #: 18274227 | FeeUserId - 6659 | Client # - 004219 | Study # - 0025
+4.002sStudy Found: #- 117870 | Timekeeper - 2 | Office - 13250
+4.009sProcessing #: 18274228 | FeeUserId - 6659 | Client # - 304169 | Study # - 0004
+4.016sStudy Found: #- 91289 | Timekeeper - 2 | Office - 15500
+4.022sProcessing #: 18274229 | FeeUserId - 6659 | Client # - 004969 | Study # - 0009
+4.029sStudy Found: #- 63536 | Timekeeper - 2 | Office - 18500
+4.035sProcessing #: 18274230 | FeeUserId - 6659 | Client # - 010662 | Study # - 0018
+4.042sStudy Found: #- 90356 | Timekeeper - 2 | Office - 13250
+4.048sProcessing #: 18274231 | FeeUserId - 6659 | Client # - 004570 | Study # - 0011
+4.055sStudy Found: #- 63345 | Timekeeper - 2 | Office - 11000
+4.061sProcessing #: 18274232 | FeeUserId - 6659 | Client # - 317465 | Study # - 0001
+4.067sStudy Found: #- 100086 | Timekeeper - 2 | Office - 15500
+4.074sProcessing #: 18274233 | FeeUserId - 6659 | Client # - 002857 | Study # - 0018
+4.081sStudy Found: #- 20140 | Timekeeper - 2 | Office - 13750
+4.087sProcessing #: 18274234 | FeeUserId - 6659 | Client # - 305633 | Study # - 0002
+4.094sStudy Found: #- 74215 | Timekeeper - 2 | Office - 18500
+4.100sProcessing #: 18274235 | FeeUserId - 6659 | Client # - 309185 | Study # - 0002
+4.107sStudy Found: #- 96517 | Timekeeper - 2 | Office - 15500
+4.113sProcessing #: 18274236 | FeeUserId - 6659 | Client # - 308165 | Study # - 0002
+4.120sStudy Found: #- 80792 | Timekeeper - 2 | Office - 20250
+4.128sProcessing #: 18274237 | FeeUserId - 6659 | Client # - 307379 | Study # - 0002
+4.136sStudy Found: #- 79336 | Timekeeper - 2 | Office - 11000
+4.142sProcessing #: 18274238 | FeeUserId - 6659 | Client # - 304577 | Study # - 0002
+4.148sStudy Found: #- 83093 | Timekeeper - 2 | Office - 16500
+4.155sProcessing #: 18274239 | FeeUserId - 6659 | Client # - 305221 | Study # - 0003
+4.160sStudy Found: #- 71236 | Timekeeper - 2 | Office - 17750
+4.167sProcessing #: 18274240 | FeeUserId - 6659 | Client # - 304978 | Study # - 0002
+4.174sStudy Found: #- 70293 | Timekeeper - 2 | Office - 11000
+4.180sProcessing #: 18274241 | FeeUserId - 6659 | Client # - 012417 | Study # - 0003
+4.186sStudy Found: #- 79839 | Timekeeper - 2 | Office - 11000
+4.192sProcessing #: 18274242 | FeeUserId - 6659 | Client # - 014058 | Study # - 0001
+4.204sStudy Found: #- 23239 | Timekeeper - 2 | Office - 11500
+4.211sProcessing #: 18274243 | FeeUserId - 6659 | Client # - 000690 | Study # - 0015
+4.217sStudy Found: #- 53612 | Timekeeper - 2 | Office - 17750
+4.223sProcessing #: 18274244 | FeeUserId - 6659 | Client # - 308375 | Study # - 0004
+4.231sStudy Found: #- 87806 | Timekeeper - 2 | Office - 14250
+4.237sProcessing #: 18274245 | FeeUserId - 6659 | Client # - 304983 | Study # - 0003
+4.244sStudy Found: #- 70318 | Timekeeper - 2 | Office - 16500
+4.251sProcessing #: 18274246 | FeeUserId - 6659 | Client # - 304525 | Study # - 0002
+4.261sStudy Found: #- 66857 | Timekeeper - 2 | Office - 11000
+4.269sProcessing #: 18274247 | FeeUserId - 6659 | Client # - 304491 | Study # - 0001
+4.276sStudy Found: #- 62643 | Timekeeper - 2 | Office - 16500
+4.283sProcessing #: 18274248 | FeeUserId - 6659 | Client # - 304169 | Study # - 0002
+4.291sStudy Found: #- 78262 | Timekeeper - 2 | Office - 15500
+4.297sProcessing #: 18274249 | FeeUserId - 6659 | Client # - 305463 | Study # - 0001
+4.304sStudy Found: #- 72922 | Timekeeper - 2 | Office - 13750
+4.311sProcessing #: 18274250 | FeeUserId - 6659 | Client # - 305493 | Study # - 0002
+4.317sStudy Found: #- 73172 | Timekeeper - 2 | Office - 11000
+4.325sProcessing #: 18274251 | FeeUserId - 6659 | Client # - 305744 | Study # - 0002
+4.333sStudy Found: #- 74939 | Timekeeper - 2 | Office - 11000
+4.339sProcessing #: 18274252 | FeeUserId - 6659 | Client # - 305815 | Study # - 0002
+4.346sStudy Found: #- 75227 | Timekeeper - 2 | Office - 11000
+4.352sProcessing #: 18274253 | FeeUserId - 6659 | Client # - 012609 | Study # - 0006
+4.360sStudy Found: #- 80011 | Timekeeper - 2 | Office - 16000
+4.366sProcessing #: 18274254 | FeeUserId - 6659 | Client # - 302517 | Study # - 0004
+4.373sStudy Found: #- 95163 | Timekeeper - 2 | Office - 11000
+4.378sProcessing #: 18274255 | FeeUserId - 6659 | Client # - 307542 | Study # - 0003
+4.386sStudy Found: #- 80342 | Timekeeper - 2 | Office - 11000
+4.392sProcessing #: 18274256 | FeeUserId - 6659 | Client # - 004905 | Study # - 0004
+4.399sStudy Found: #- 73816 | Timekeeper - 2 | Office - 15000
+4.405sProcessing #: 18274257 | FeeUserId - 6659 | Client # - 302901 | Study # - 0001
+4.413sStudy Found: #- 58490 | Timekeeper - 2 | Office - 18500
+4.420sProcessing #: 18274258 | FeeUserId - 6659 | Client # - 306791 | Study # - 0002
+4.428sStudy Found: #- 78146 | Timekeeper - 2 | Office - 16000
+4.434sProcessing #: 18274259 | FeeUserId - 6659 | Client # - 309114 | Study # - 0002
+4.441sStudy Found: #- 82967 | Timekeeper - 2 | Office - 20000
+4.447sProcessing #: 18274260 | FeeUserId - 6659 | Client # - 304726 | Study # - 0003
+4.454sStudy Found: #- 82417 | Timekeeper - 2 | Office - 20500
+4.460sProcessing #: 18274261 | FeeUserId - 6659 | Client # - 313247 | Study # - 0001
+4.470sStudy Found: #- 92780 | Timekeeper - 2 | Office - 20250
+4.477sProcessing #: 18274262 | FeeUserId - 6659 | Client # - 313815 | Study # - 0001
+4.484sStudy Found: #- 93813 | Timekeeper - 2 | Office - 17250
+4.490sProcessing #: 18274263 | FeeUserId - 6659 | Client # - 009812 | Study # - 0004
+4.497sStudy Found: #- 93242 | Timekeeper - 2 | Office - 15500
+4.503sProcessing #: 18274264 | FeeUserId - 6659 | Client # - 011391 | Study # - 0004
+4.509sStudy Found: #- 94053 | Timekeeper - 2 | Office - 20500
+4.516sProcessing #: 18274265 | FeeUserId - 6659 | Client # - 314053 | Study # - 0001
+4.523sStudy Found: #- 94222 | Timekeeper - 2 | Office - 18500
+4.530sProcessing #: 18274266 | FeeUserId - 6659 | Client # - 314202 | Study # - 0001
+4.537sStudy Found: #- 94686 | Timekeeper - 2 | Office - 20000
+4.543sProcessing #: 18274267 | FeeUserId - 6659 | Client # - 315231 | Study # - 0003
+4.551sStudy Found: #- 97126 | Timekeeper - 2 | Office - 22000
+4.563sProcessing #: 18274268 | FeeUserId - 6659 | Client # - 314424 | Study # - 0002
+4.570sStudy Found: #- 95020 | Timekeeper - 2 | Office - 11000
+4.577sProcessing #: 18274269 | FeeUserId - 6659 | Client # - 315159 | Study # - 0001
+4.584sStudy Found: #- 96245 | Timekeeper - 2 | Office - 16500
+4.591sProcessing #: 18274270 | FeeUserId - 6659 | Client # - 315203 | Study # - 0002
+4.598sStudy Found: #- 96325 | Timekeeper - 2 | Office - 21500
+4.605sProcessing #: 18274271 | FeeUserId - 6659 | Client # - 315225 | Study # - 0002
+4.614sStudy Found: #- 96369 | Timekeeper - 2 | Office - 13250
+4.621sProcessing #: 18274272 | FeeUserId - 6659 | Client # - 315798 | Study # - 0001
+4.627sStudy Found: #- 97307 | Timekeeper - 2 | Office - 11000
+4.634sProcessing #: 18274273 | FeeUserId - 6659 | Client # - 308732 | Study # - 0003
+4.640sStudy Found: #- 97005 | Timekeeper - 2 | Office - 12750
+4.647sProcessing #: 18274274 | FeeUserId - 6659 | Client # - 316003 | Study # - 0001
+4.654sStudy Found: #- 97625 | Timekeeper - 2 | Office - 13250
+4.660sProcessing #: 18274275 | FeeUserId - 6659 | Client # - 308881 | Study # - 0003
+4.667sStudy Found: #- 83755 | Timekeeper - 2 | Office - 19250
+4.676sProcessing #: 18274276 | FeeUserId - 6659 | Client # - 309629 | Study # - 0002
+4.682sStudy Found: #- 84549 | Timekeeper - 2 | Office - 21250
+4.689sProcessing #: 18274277 | FeeUserId - 6659 | Client # - 310302 | Study # - 0002
+4.696sStudy Found: #- 84728 | Timekeeper - 2 | Office - 20250
+4.702sProcessing #: 18274278 | FeeUserId - 6659 | Client # - 308961 | Study # - 0003
+4.709sStudy Found: #- 84987 | Timekeeper - 2 | Office - 21500
+4.716sProcessing #: 18274279 | FeeUserId - 6659 | Client # - 310570 | Study # - 0002
+4.722sStudy Found: #- 85057 | Timekeeper - 2 | Office - 13250
+4.728sProcessing #: 18274280 | FeeUserId - 6659 | Client # - 311512 | Study # - 0002
+4.743sStudy Found: #- 86460 | Timekeeper - 2 | Office - 18000
+4.751sSending to 3E: Started

+1h 53m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 10 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 1:34:20 PM

+977ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
2f565ebd
+31msOfflineTimeCommitTo3ECommandHandler - Started
+911msNo of records retrieved : 157

+1h 10m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 9 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 11:40:53 AM

+576ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+64ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
720eb24e
+70msOfflineTimeCommitTo3ECommandHandler - Started
+534msNo of records retrieved : 157

+44m 16.610s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 8 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 10:30:06 AM

+407ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
8dce150c
+28msOfflineTimeCommitTo3ECommandHandler - Started
+325msNo of records retrieved : 157

+24m 15.413s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+57ms Scheduled

Retry attempt 7 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 9:45:54 AM

+783ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+27ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
4c502b0d
+34msOfflineTimeCommitTo3ECommandHandler - Started
+692msNo of records retrieved : 157

+12m 29.126s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 6 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 9:21:35 AM

+1.326s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+30ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
720eb24e
+38msOfflineTimeCommitTo3ECommandHandler - Started
+1.185sNo of records retrieved : 157

+4m 59.880s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 5 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 9:09:07 AM

+324ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
4c502b0d
+23msOfflineTimeCommitTo3ECommandHandler - Started
+261msNo of records retrieved : 157

+1m 44.643s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+23ms Scheduled

Retry attempt 4 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 9:04:06 AM

+350ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+64ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
8dce150c
+70msOfflineTimeCommitTo3ECommandHandler - Started
+350msNo of records retrieved : 157

+44.563s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 3 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 9:02:24 AM

+514ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
a3acbfd8
+20msOfflineTimeCommitTo3ECommandHandler - Started
+445msNo of records retrieved : 157

+59.724s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 2 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 9:01:41 AM

+397ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
4c502b0d
+22msOfflineTimeCommitTo3ECommandHandler - Started
+331msNo of records retrieved : 157

+38.037s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 1 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 9:00:35 AM

+1.984s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+100ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
8dce150c
+105msOfflineTimeCommitTo3ECommandHandler - Started
+1.995sNo of records retrieved : 157

+6ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-billing

10/21/2023 9:00:01 AM Created