alliantONE Hangfire Dashboard

IOfflineTimeCommitTo3ECommandHandler.Run

// Job ID: #76451
using AG.A1.Scheduler.Billing.Contracts;

var offlineTimeCommitTo3ECommandHandler = Activate<IOfflineTimeCommitTo3ECommandHandler>();
await offlineTimeCommitTo3ECommandHandler.Run(null, null);

Parameters

CurrentCulture 
"en-US"
CurrentUICulture 
"en-US"
RecurringJobId 
"TMS-Sync-Offline-TimeEntries-To-3E-Task"
RetryCount 
10
Time 
1697882403

State

10/21/2023 2:36:59 PM (+1m 32.553s) Failed

An exception occurred during performance of the job.

System.NullReferenceException

Object reference not set to an instance of an object.

System.NullReferenceException: Object reference not set to an instance of an object.
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.SendBulkTimeEntriesTo3E(IEnumerable`1 timeEntries, PerformContext performContext) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 306
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 69
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+27ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
a3acbfd8
+29msOfflineTimeCommitTo3ECommandHandler - Started
+160msNo of records retrieved : 157
+2.860sProcessing #: 18274181 | FeeUserId - 6659 | Client # - 304961 | Study # - 0005
+2.873sStudy Not Found
+2.880sProcessing #: 18274182 | FeeUserId - 6659 | Client # - 310711 | Study # - 0004
+2.887sStudy Not Found
+2.894sProcessing #: 18274183 | FeeUserId - 6659 | Client # - 331576 | Study # - 0002
+2.906sStudy Not Found
+2.912sProcessing #: 18274184 | FeeUserId - 6659 | Client # - 331601 | Study # - 0001
+2.919sStudy Found: #- 126257 | Timekeeper - 2 | Office - 11000
+2.925sProcessing #: 18274185 | FeeUserId - 6659 | Client # - 309663 | Study # - 0001
+2.932sStudy Found: #- 83776 | Timekeeper - 2 | Office - 11750
+2.942sProcessing #: 18274186 | FeeUserId - 6659 | Client # - 314417 | Study # - 0001
+2.949sStudy Found: #- 95009 | Timekeeper - 2 | Office - 19000
+2.956sProcessing #: 18274187 | FeeUserId - 6659 | Client # - 309413 | Study # - 0002
+2.962sStudy Found: #- 83404 | Timekeeper - 2 | Office - 00000
+2.968sProcessing #: 18274188 | FeeUserId - 6659 | Client # - 310138 | Study # - 0002
+2.975sStudy Found: #- 84512 | Timekeeper - 2 | Office - 11500
+2.981sProcessing #: 18274189 | FeeUserId - 6659 | Client # - 310809 | Study # - 0002
+2.988sStudy Found: #- 85430 | Timekeeper - 2 | Office - 13250
+2.995sProcessing #: 18274190 | FeeUserId - 6659 | Client # - 316696 | Study # - 0002
+3.012sStudy Found: #- 98842 | Timekeeper - 2 | Office - 11000
+3.017sProcessing #: 18274191 | FeeUserId - 6659 | Client # - 303641 | Study # - 0002
+3.029sStudy Found: #- 65965 | Timekeeper - 2 | Office - 18750
+3.035sProcessing #: 18274192 | FeeUserId - 6659 | Client # - 304516 | Study # - 0003
+3.044sStudy Found: #- 65592 | Timekeeper - 2 | Office - 16250
+3.053sProcessing #: 18274193 | FeeUserId - 6659 | Client # - 304516 | Study # - 0002
+3.059sStudy Found: #- 65584 | Timekeeper - 2 | Office - 16250
+3.066sProcessing #: 18274194 | FeeUserId - 6659 | Client # - 007914 | Study # - 0010
+3.072sStudy Found: #- 89415 | Timekeeper - 2 | Office - 11000
+3.079sProcessing #: 18274195 | FeeUserId - 6659 | Client # - 301137 | Study # - 0007
+3.087sStudy Found: #- 117463 | Timekeeper - 2 | Office - 12250
+3.094sProcessing #: 18274196 | FeeUserId - 6659 | Client # - 300912 | Study # - 0004
+3.101sStudy Found: #- 90097 | Timekeeper - 2 | Office - 13000
+3.107sProcessing #: 18274197 | FeeUserId - 6659 | Client # - 303815 | Study # - 0002
+3.113sStudy Found: #- 66056 | Timekeeper - 2 | Office - 13000
+3.119sProcessing #: 18274198 | FeeUserId - 6659 | Client # - 013027 | Study # - 0002
+3.125sStudy Found: #- 17262 | Timekeeper - 2 | Office - 12000
+3.132sProcessing #: 18274199 | FeeUserId - 6659 | Client # - 003362 | Study # - 0012
+3.138sStudy Found: #- 53814 | Timekeeper - 2 | Office - 12000
+3.146sProcessing #: 18274200 | FeeUserId - 6659 | Client # - 010894 | Study # - 0007
+3.154sStudy Found: #- 72451 | Timekeeper - 2 | Office - 20500
+3.158sProcessing #: 18274201 | FeeUserId - 6659 | Client # - 301924 | Study # - 0001
+3.165sStudy Found: #- 53389 | Timekeeper - 2 | Office - 11000
+3.171sProcessing #: 18274202 | FeeUserId - 6659 | Client # - 306547 | Study # - 0002
+3.178sStudy Found: #- 77595 | Timekeeper - 2 | Office - 20500
+3.183sProcessing #: 18274203 | FeeUserId - 6659 | Client # - 307683 | Study # - 0002
+3.190sStudy Found: #- 79940 | Timekeeper - 2 | Office - 21500
+3.196sProcessing #: 18274204 | FeeUserId - 6659 | Client # - 304673 | Study # - 0023
+3.203sStudy Found: #- 118872 | Timekeeper - 2 | Office - 16500
+3.209sProcessing #: 18274205 | FeeUserId - 6659 | Client # - 005836 | Study # - 0002
+3.216sStudy Found: #- 51674 | Timekeeper - 2 | Office - 17250
+3.222sProcessing #: 18274206 | FeeUserId - 6659 | Client # - 311892 | Study # - 0003
+3.233sStudy Found: #- 102920 | Timekeeper - 2 | Office - 13000
+3.250sProcessing #: 18274207 | FeeUserId - 6659 | Client # - 304549 | Study # - 0001
+3.257sStudy Found: #- 65560 | Timekeeper - 2 | Office - 18000
+3.263sProcessing #: 18274208 | FeeUserId - 6659 | Client # - 320813 | Study # - 0001
+3.270sStudy Found: #- 105143 | Timekeeper - 2 | Office - 17750
+3.275sProcessing #: 18274209 | FeeUserId - 6659 | Client # - 303960 | Study # - 0001
+3.283sStudy Found: #- 61232 | Timekeeper - 2 | Office - 13250
+3.291sProcessing #: 18274210 | FeeUserId - 6659 | Client # - 304883 | Study # - 0001
+3.299sStudy Found: #- 69841 | Timekeeper - 2 | Office - 13750
+3.305sProcessing #: 18274211 | FeeUserId - 6659 | Client # - 012355 | Study # - 0010
+3.312sStudy Found: #- 70359 | Timekeeper - 2 | Office - 11000
+3.318sProcessing #: 18274212 | FeeUserId - 6659 | Client # - 006871 | Study # - 0008
+3.324sStudy Found: #- 74316 | Timekeeper - 2 | Office - 18500
+3.330sProcessing #: 18274213 | FeeUserId - 6659 | Client # - 300980 | Study # - 0002
+3.338sStudy Found: #- 61791 | Timekeeper - 2 | Office - 20500
+3.345sProcessing #: 18274214 | FeeUserId - 6659 | Client # - 302275 | Study # - 0002
+3.352sStudy Found: #- 73530 | Timekeeper - 2 | Office - 11000
+3.358sProcessing #: 18274215 | FeeUserId - 6659 | Client # - 014593 | Study # - 0005
+3.364sStudy Found: #- 70555 | Timekeeper - 2 | Office - 13000
+3.370sProcessing #: 18274216 | FeeUserId - 6659 | Client # - 014609 | Study # - 0004
+3.375sStudy Found: #- 70159 | Timekeeper - 2 | Office - 11500
+3.382sProcessing #: 18274217 | FeeUserId - 6659 | Client # - 303043 | Study # - 0002
+3.388sStudy Found: #- 66698 | Timekeeper - 2 | Office - 11000
+3.396sProcessing #: 18274218 | FeeUserId - 6659 | Client # - 301517 | Study # - 0002
+3.405sStudy Found: #- 65742 | Timekeeper - 2 | Office - 13000
+3.411sProcessing #: 18274219 | FeeUserId - 6659 | Client # - 304223 | Study # - 0001
+3.418sStudy Found: #- 61780 | Timekeeper - 2 | Office - 19750
+3.423sProcessing #: 18274220 | FeeUserId - 6659 | Client # - 001500 | Study # - 0007
+3.430sStudy Found: #- 79243 | Timekeeper - 2 | Office - 21500
+3.439sProcessing #: 18274221 | FeeUserId - 6659 | Client # - 306420 | Study # - 0002
+3.446sStudy Found: #- 77292 | Timekeeper - 2 | Office - 13000
+3.453sProcessing #: 18274222 | FeeUserId - 6659 | Client # - 014442 | Study # - 0007
+3.459sStudy Found: #- 84263 | Timekeeper - 2 | Office - 13750
+3.465sProcessing #: 18274223 | FeeUserId - 6659 | Client # - 304988 | Study # - 0003
+3.471sStudy Found: #- 70349 | Timekeeper - 2 | Office - 14000
+3.477sProcessing #: 18274224 | FeeUserId - 6659 | Client # - 304790 | Study # - 0002
+3.483sStudy Found: #- 69390 | Timekeeper - 2 | Office - 12250
+3.489sProcessing #: 18274225 | FeeUserId - 6659 | Client # - 304362 | Study # - 0002
+3.496sStudy Found: #- 65904 | Timekeeper - 2 | Office - 16000
+3.503sProcessing #: 18274226 | FeeUserId - 6659 | Client # - 005668 | Study # - 0010
+3.510sStudy Found: #- 63719 | Timekeeper - 2 | Office - 19000
+3.516sProcessing #: 18274227 | FeeUserId - 6659 | Client # - 004219 | Study # - 0025
+3.522sStudy Found: #- 117870 | Timekeeper - 2 | Office - 13250
+3.528sProcessing #: 18274228 | FeeUserId - 6659 | Client # - 304169 | Study # - 0004
+3.534sStudy Found: #- 91289 | Timekeeper - 2 | Office - 15500
+3.540sProcessing #: 18274229 | FeeUserId - 6659 | Client # - 004969 | Study # - 0009
+3.548sStudy Found: #- 63536 | Timekeeper - 2 | Office - 18500
+3.554sProcessing #: 18274230 | FeeUserId - 6659 | Client # - 010662 | Study # - 0018
+3.560sStudy Found: #- 90356 | Timekeeper - 2 | Office - 13250
+3.570sProcessing #: 18274231 | FeeUserId - 6659 | Client # - 004570 | Study # - 0011
+3.577sStudy Found: #- 63345 | Timekeeper - 2 | Office - 11000
+3.582sProcessing #: 18274232 | FeeUserId - 6659 | Client # - 317465 | Study # - 0001
+3.589sStudy Found: #- 100086 | Timekeeper - 2 | Office - 15500
+3.596sProcessing #: 18274233 | FeeUserId - 6659 | Client # - 002857 | Study # - 0018
+3.603sStudy Found: #- 20140 | Timekeeper - 2 | Office - 13750
+3.609sProcessing #: 18274234 | FeeUserId - 6659 | Client # - 305633 | Study # - 0002
+3.618sStudy Found: #- 74215 | Timekeeper - 2 | Office - 18500
+3.624sProcessing #: 18274235 | FeeUserId - 6659 | Client # - 309185 | Study # - 0002
+3.630sStudy Found: #- 96517 | Timekeeper - 2 | Office - 15500
+3.638sProcessing #: 18274236 | FeeUserId - 6659 | Client # - 308165 | Study # - 0002
+3.646sStudy Found: #- 80792 | Timekeeper - 2 | Office - 20250
+3.655sProcessing #: 18274237 | FeeUserId - 6659 | Client # - 307379 | Study # - 0002
+3.665sStudy Found: #- 79336 | Timekeeper - 2 | Office - 11000
+3.674sProcessing #: 18274238 | FeeUserId - 6659 | Client # - 304577 | Study # - 0002
+3.683sStudy Found: #- 83093 | Timekeeper - 2 | Office - 16500
+3.692sProcessing #: 18274239 | FeeUserId - 6659 | Client # - 305221 | Study # - 0003
+3.700sStudy Found: #- 71236 | Timekeeper - 2 | Office - 17750
+3.706sProcessing #: 18274240 | FeeUserId - 6659 | Client # - 304978 | Study # - 0002
+3.712sStudy Found: #- 70293 | Timekeeper - 2 | Office - 11000
+3.717sProcessing #: 18274241 | FeeUserId - 6659 | Client # - 012417 | Study # - 0003
+3.724sStudy Found: #- 79839 | Timekeeper - 2 | Office - 11000
+3.729sProcessing #: 18274242 | FeeUserId - 6659 | Client # - 014058 | Study # - 0001
+3.737sStudy Found: #- 23239 | Timekeeper - 2 | Office - 11500
+3.744sProcessing #: 18274243 | FeeUserId - 6659 | Client # - 000690 | Study # - 0015
+3.750sStudy Found: #- 53612 | Timekeeper - 2 | Office - 17750
+3.757sProcessing #: 18274244 | FeeUserId - 6659 | Client # - 308375 | Study # - 0004
+3.764sStudy Found: #- 87806 | Timekeeper - 2 | Office - 14250
+3.770sProcessing #: 18274245 | FeeUserId - 6659 | Client # - 304983 | Study # - 0003
+3.776sStudy Found: #- 70318 | Timekeeper - 2 | Office - 16500
+3.782sProcessing #: 18274246 | FeeUserId - 6659 | Client # - 304525 | Study # - 0002
+3.790sStudy Found: #- 66857 | Timekeeper - 2 | Office - 11000
+3.796sProcessing #: 18274247 | FeeUserId - 6659 | Client # - 304491 | Study # - 0001
+3.803sStudy Found: #- 62643 | Timekeeper - 2 | Office - 16500
+3.809sProcessing #: 18274248 | FeeUserId - 6659 | Client # - 304169 | Study # - 0002
+3.816sStudy Found: #- 78262 | Timekeeper - 2 | Office - 15500
+3.822sProcessing #: 18274249 | FeeUserId - 6659 | Client # - 305463 | Study # - 0001
+3.829sStudy Found: #- 72922 | Timekeeper - 2 | Office - 13750
+3.836sProcessing #: 18274250 | FeeUserId - 6659 | Client # - 305493 | Study # - 0002
+3.842sStudy Found: #- 73172 | Timekeeper - 2 | Office - 11000
+3.850sProcessing #: 18274251 | FeeUserId - 6659 | Client # - 305744 | Study # - 0002
+3.858sStudy Found: #- 74939 | Timekeeper - 2 | Office - 11000
+3.864sProcessing #: 18274252 | FeeUserId - 6659 | Client # - 305815 | Study # - 0002
+3.871sStudy Found: #- 75227 | Timekeeper - 2 | Office - 11000
+3.878sProcessing #: 18274253 | FeeUserId - 6659 | Client # - 012609 | Study # - 0006
+3.884sStudy Found: #- 80011 | Timekeeper - 2 | Office - 16000
+3.895sProcessing #: 18274254 | FeeUserId - 6659 | Client # - 302517 | Study # - 0004
+3.902sStudy Found: #- 95163 | Timekeeper - 2 | Office - 11000
+3.908sProcessing #: 18274255 | FeeUserId - 6659 | Client # - 307542 | Study # - 0003
+3.915sStudy Found: #- 80342 | Timekeeper - 2 | Office - 11000
+3.921sProcessing #: 18274256 | FeeUserId - 6659 | Client # - 004905 | Study # - 0004
+3.927sStudy Found: #- 73816 | Timekeeper - 2 | Office - 15000
+3.936sProcessing #: 18274257 | FeeUserId - 6659 | Client # - 302901 | Study # - 0001
+3.943sStudy Found: #- 58490 | Timekeeper - 2 | Office - 18500
+3.950sProcessing #: 18274258 | FeeUserId - 6659 | Client # - 306791 | Study # - 0002
+3.957sStudy Found: #- 78146 | Timekeeper - 2 | Office - 16000
+3.963sProcessing #: 18274259 | FeeUserId - 6659 | Client # - 309114 | Study # - 0002
+3.969sStudy Found: #- 82967 | Timekeeper - 2 | Office - 20000
+3.976sProcessing #: 18274260 | FeeUserId - 6659 | Client # - 304726 | Study # - 0003
+3.982sStudy Found: #- 82417 | Timekeeper - 2 | Office - 20500
+3.989sProcessing #: 18274261 | FeeUserId - 6659 | Client # - 313247 | Study # - 0001
+3.998sStudy Found: #- 92780 | Timekeeper - 2 | Office - 20250
+4.003sProcessing #: 18274262 | FeeUserId - 6659 | Client # - 313815 | Study # - 0001
+4.010sStudy Found: #- 93813 | Timekeeper - 2 | Office - 17250
+4.017sProcessing #: 18274263 | FeeUserId - 6659 | Client # - 009812 | Study # - 0004
+4.024sStudy Found: #- 93242 | Timekeeper - 2 | Office - 15500
+4.030sProcessing #: 18274264 | FeeUserId - 6659 | Client # - 011391 | Study # - 0004
+4.038sStudy Found: #- 94053 | Timekeeper - 2 | Office - 20500
+4.043sProcessing #: 18274265 | FeeUserId - 6659 | Client # - 314053 | Study # - 0001
+4.050sStudy Found: #- 94222 | Timekeeper - 2 | Office - 18500
+4.056sProcessing #: 18274266 | FeeUserId - 6659 | Client # - 314202 | Study # - 0001
+4.067sStudy Found: #- 94686 | Timekeeper - 2 | Office - 20000
+4.074sProcessing #: 18274267 | FeeUserId - 6659 | Client # - 315231 | Study # - 0003
+4.082sStudy Found: #- 97126 | Timekeeper - 2 | Office - 22000
+4.088sProcessing #: 18274268 | FeeUserId - 6659 | Client # - 314424 | Study # - 0002
+4.097sStudy Found: #- 95020 | Timekeeper - 2 | Office - 11000
+4.104sProcessing #: 18274269 | FeeUserId - 6659 | Client # - 315159 | Study # - 0001
+4.111sStudy Found: #- 96245 | Timekeeper - 2 | Office - 16500
+4.116sProcessing #: 18274270 | FeeUserId - 6659 | Client # - 315203 | Study # - 0002
+4.125sStudy Found: #- 96325 | Timekeeper - 2 | Office - 21500
+4.132sProcessing #: 18274271 | FeeUserId - 6659 | Client # - 315225 | Study # - 0002
+4.140sStudy Found: #- 96369 | Timekeeper - 2 | Office - 13250
+4.146sProcessing #: 18274272 | FeeUserId - 6659 | Client # - 315798 | Study # - 0001
+4.152sStudy Found: #- 97307 | Timekeeper - 2 | Office - 11000
+4.166sProcessing #: 18274273 | FeeUserId - 6659 | Client # - 308732 | Study # - 0003
+4.172sStudy Found: #- 97005 | Timekeeper - 2 | Office - 12750
+4.178sProcessing #: 18274274 | FeeUserId - 6659 | Client # - 316003 | Study # - 0001
+4.184sStudy Found: #- 97625 | Timekeeper - 2 | Office - 13250
+4.190sProcessing #: 18274275 | FeeUserId - 6659 | Client # - 308881 | Study # - 0003
+4.200sStudy Found: #- 83755 | Timekeeper - 2 | Office - 19250
+4.206sProcessing #: 18274276 | FeeUserId - 6659 | Client # - 309629 | Study # - 0002
+4.212sStudy Found: #- 84549 | Timekeeper - 2 | Office - 21250
+4.218sProcessing #: 18274277 | FeeUserId - 6659 | Client # - 310302 | Study # - 0002
+4.224sStudy Found: #- 84728 | Timekeeper - 2 | Office - 20250
+4.230sProcessing #: 18274278 | FeeUserId - 6659 | Client # - 308961 | Study # - 0003
+4.236sStudy Found: #- 84987 | Timekeeper - 2 | Office - 21500
+4.244sProcessing #: 18274279 | FeeUserId - 6659 | Client # - 310570 | Study # - 0002
+4.250sStudy Found: #- 85057 | Timekeeper - 2 | Office - 13250
+4.256sProcessing #: 18274280 | FeeUserId - 6659 | Client # - 311512 | Study # - 0002
+4.261sStudy Found: #- 86460 | Timekeeper - 2 | Office - 18000
+4.267sSending to 3E: Started

+1h 53m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 10 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 2:35:13 PM

+503ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
4c502b0d
+28msOfflineTimeCommitTo3ECommandHandler - Started
+420msNo of records retrieved : 157

+1h 9m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+14ms Scheduled

Retry attempt 9 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 12:41:52 PM

+293ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+23ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
a3acbfd8
+27msOfflineTimeCommitTo3ECommandHandler - Started
+225msNo of records retrieved : 157

+43m 32.004s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 8 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
10/21/2023 11:32:14 AM

+67ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Billing.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Billing.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Billing.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+23m 59.370s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+6ms Scheduled

Retry attempt 7 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 10:48:44 AM

+1.664s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+23ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
8dce150c
+54msOfflineTimeCommitTo3ECommandHandler - Started
+1.445sNo of records retrieved : 157

+12m 59.120s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 6 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 10:24:44 AM

+1.407s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+60ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
2f565ebd
+24msOfflineTimeCommitTo3ECommandHandler - Started
+1.270sNo of records retrieved : 157

+5m 44.177s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 5 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 10:11:31 AM

+1.207s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
a3acbfd8
+23msOfflineTimeCommitTo3ECommandHandler - Started
+1.120sNo of records retrieved : 157

+2m 29.727s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 4 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 10:05:57 AM

+327ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
720eb24e
+24msOfflineTimeCommitTo3ECommandHandler - Started
+260msNo of records retrieved : 157

+1m 44.470s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 3 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 10:03:24 AM

+593ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+17ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
2f565ebd
+21msOfflineTimeCommitTo3ECommandHandler - Started
+487msNo of records retrieved : 157

+58.827s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 2 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 10:01:37 AM

+1.200s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
8dce150c
+21msOfflineTimeCommitTo3ECommandHandler - Started
+1.139sNo of records retrieved : 157

+37.314s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 1 of 10: Request failed with status code InternalServerErr…

Enqueue at:
10/21/2023 10:00:34 AM

+2.876s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 354
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 187
   at AG.Integrations.RESTClients.E3EWrapperREST.TransactionControllers.E3ERestWrapperApiClientController.IsServiceAvailable() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\E3EWrapperREST\TransactionControllers\E3ERestWrapperApiClientController.cs:line 23
   at AG.A1.Scheduler.Billing.Application.Features.CommitTimeTo3E.Commands.OfflineTimeCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Billing.Application\Features\CommitTimeTo3E\Commands\OfflineTimeCommitTo3ECommandHandler.cs:line 63
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+24ms Processing

Server:
dw1sdwk0006wl:8048
Worker:
a3acbfd8
+33msOfflineTimeCommitTo3ECommandHandler - Started
+2.578sNo of records retrieved : 157

+10ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-billing

10/21/2023 10:00:03 AM Created