alliantONE Hangfire Dashboard

IForwardTranscriptAlerts.Run

// Job ID: #342899
using AG.A1.Scheduler.Project.Contracts.Contracts.TCSPitBull;

var forwardTranscriptAlerts = Activate<IForwardTranscriptAlerts>();
await forwardTranscriptAlerts.Run(null, null);

Parameters

CurrentCulture 
"en-US"
CurrentUICulture 
"en-US"
RecurringJobId 
"Forward-Transcript-Alerts-Task"
RetryCount 
10
Time 
1760526005

State

10/15/2025 3:31:20 PM (+32.810s) Failed

An exception occurred during performance of the job.

System.AggregateException

Too many retries performed. More than 3 retries encountered while sending the request. (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached) (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached) (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached) (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached)

System.AggregateException: Too many retries performed. More than 3 retries encountered while sending the request. (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached) (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached) (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached) (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached)
 ---> Microsoft.Kiota.Abstractions.ApiException: HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached
   --- End of inner exception stack trace ---
   at Microsoft.Kiota.Http.HttpClientLibrary.Middleware.RetryHandler.SendRetryAsync(HttpResponseMessage response, RetryHandlerOption retryOption, CancellationToken cancellationToken, ActivitySource activitySource)
   at Microsoft.Kiota.Http.HttpClientLibrary.Middleware.RetryHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
   at Microsoft.Kiota.Http.HttpClientLibrary.Middleware.UriReplacementHandler`1.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   at Microsoft.Kiota.Http.HttpClientLibrary.HttpClientRequestAdapter.GetHttpResponseMessageAsync(RequestInformation requestInfo, CancellationToken cancellationToken, Activity activityForAttributes, String claims, Boolean isStreamResponse)
   at Microsoft.Kiota.Http.HttpClientLibrary.HttpClientRequestAdapter.SendAsync[ModelType](RequestInformation requestInfo, ParsableFactory`1 factory, Dictionary`2 errorMapping, CancellationToken cancellationToken)
   at Microsoft.Graph.Users.Item.MailFolders.Item.Messages.MessagesRequestBuilder.GetAsync(Action`1 requestConfiguration, CancellationToken cancellationToken)
   at AG.A1.Scheduler.Project.Application.Features.TCSPitBull.ForwardTranscriptAlertsTask.GetEmails(PerformContext context) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\TCSPitBull\ForwardTranscriptAlertsTask.cs:line 259
   at AG.A1.Scheduler.Project.Application.Features.TCSPitBull.ForwardTranscriptAlertsTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\TCSPitBull\ForwardTranscriptAlertsTask.cs:line 45
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+23ms Processing

Server:
dw1sdwk000bbd:2732
Worker:
dc503531
+27msForwardTranscriptAlertsTask - Started at 10/15/2025 3:30:48 PM
+77msFinding emails starting: 2025-09-05T15:30:48Z
+2.825sGetEmails: Total Email Message Count: 86
+32.112sForwardTranscriptAlertsTask - Failed at 10/15/2025 3:31:20 PMToo many retries performed. More than 3 retries encountered while sending the request. (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached) (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached) (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached) (HTTP request failed with status code: ServiceUnavailable.Authentication Concurrency Limit Reached)

+1h 51m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 10 of 10: Index was outside the bounds of the array.

Enqueue at:
10/15/2025 3:30:35 PM

+4.747s Failed

An exception occurred during performance of the job.

System.IndexOutOfRangeException

Index was outside the bounds of the array.

System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at AG.A1.Scheduler.Project.Application.Features.TCSPitBull.ForwardTranscriptAlertsTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\TCSPitBull\ForwardTranscriptAlertsTask.cs:line 0
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+23ms Processing

Server:
dw1sdwk000bbd:2732
Worker:
3afc1fdf
+36msForwardTranscriptAlertsTask - Started at 10/15/2025 1:39:24 PM
+82msFinding emails starting: 2025-09-05T13:39:24Z
+1.071sGetEmails: Total Email Message Count: 86
+4.691sGetEmails: Email Messages Collection Count: 86
+4.710sForwardTranscriptAlertsTask - Failed at 10/15/2025 1:39:29 PMIndex was outside the bounds of the array.

+1h 9m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 9 of 10: Could not load type 'AG.A1.Scheduler.Project.Cont…

Enqueue at:
10/15/2025 1:39:10 PM

+130ms Failed

Can not change the state to 'Processing': target method was not found.

System.TypeLoadException

Could not load type 'AG.A1.Scheduler.Project.Contracts.Contracts.TCSPitBull.IForwardTranscriptAlerts' from assembly 'AG.A1.Scheduler.Project.Contracts, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null'.

System.TypeLoadException: Could not load type 'AG.A1.Scheduler.Project.Contracts.Contracts.TCSPitBull.IForwardTranscriptAlerts' from assembly 'AG.A1.Scheduler.Project.Contracts, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null'.
   at System.Reflection.RuntimeAssembly.GetType(QCallAssembly assembly, String name, Boolean throwOnError, Boolean ignoreCase, ObjectHandleOnStack type, ObjectHandleOnStack keepAlive, ObjectHandleOnStack assemblyLoadContext)
   at System.Reflection.RuntimeAssembly.GetType(String name, Boolean throwOnError, Boolean ignoreCase)
   at System.TypeNameParser.ResolveType(Assembly assembly, String[] names, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+43m 27.914s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+6ms Scheduled

Retry attempt 8 of 10: Index was outside the bounds of the array.

Enqueue at:
10/15/2025 12:30:13 PM

+3.930s Failed

An exception occurred during performance of the job.

System.IndexOutOfRangeException

Index was outside the bounds of the array.

System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at AG.A1.Scheduler.Project.Application.Features.TCSPitBull.ForwardTranscriptAlertsTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\TCSPitBull\ForwardTranscriptAlertsTask.cs:line 0
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000bbd:2732
Worker:
dbbc53aa
+42msForwardTranscriptAlertsTask - Started at 10/15/2025 11:46:49 AM
+74msFinding emails starting: 2025-09-05T11:46:49Z
+746msGetEmails: Total Email Message Count: 86
+3.874sGetEmails: Email Messages Collection Count: 86
+3.883sForwardTranscriptAlertsTask - Failed at 10/15/2025 11:46:53 AMIndex was outside the bounds of the array.

+24m 27.294s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+6ms Scheduled

Retry attempt 7 of 10: Index was outside the bounds of the array.

Enqueue at:
10/15/2025 11:46:40 AM

+4.014s Failed

An exception occurred during performance of the job.

System.IndexOutOfRangeException

Index was outside the bounds of the array.

System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at AG.A1.Scheduler.Project.Application.Features.TCSPitBull.ForwardTranscriptAlertsTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\TCSPitBull\ForwardTranscriptAlertsTask.cs:line 0
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000bbd:2732
Worker:
e6abd010
+32msForwardTranscriptAlertsTask - Started at 10/15/2025 11:22:18 AM
+60msFinding emails starting: 2025-09-05T11:22:18Z
+1.160sGetEmails: Total Email Message Count: 86
+3.938sGetEmails: Email Messages Collection Count: 86
+3.956sForwardTranscriptAlertsTask - Failed at 10/15/2025 11:22:22 AMIndex was outside the bounds of the array.

+11m 43.346s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+10ms Scheduled

Retry attempt 6 of 10: Index was outside the bounds of the array.

Enqueue at:
10/15/2025 11:22:14 AM

+2.080s Failed

An exception occurred during performance of the job.

System.IndexOutOfRangeException

Index was outside the bounds of the array.

System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at AG.A1.Scheduler.Project.Application.Features.TCSPitBull.ForwardTranscriptAlertsTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\TCSPitBull\ForwardTranscriptAlertsTask.cs:line 0
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+250ms Processing

Server:
dw1sdwk000bbd:2732
Worker:
9a687009
+90msForwardTranscriptAlertsTask - Started at 10/15/2025 11:10:32 AM
+127msFinding emails starting: 2025-09-05T11:10:32Z
+510msGetEmails: Total Email Message Count: 86
+2.021sGetEmails: Email Messages Collection Count: 86
+2.029sForwardTranscriptAlertsTask - Failed at 10/15/2025 11:10:34 AMIndex was outside the bounds of the array.

+5m 30.137s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+13ms Scheduled

Retry attempt 5 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
10/15/2025 11:10:28 AM

+127ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+1m 43.373s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 4 of 10: Index was outside the bounds of the array.

Enqueue at:
10/15/2025 11:04:54 AM

+1.686s Failed

An exception occurred during performance of the job.

System.IndexOutOfRangeException

Index was outside the bounds of the array.

System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at AG.A1.Scheduler.Project.Application.Features.TCSPitBull.ForwardTranscriptAlertsTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\TCSPitBull\ForwardTranscriptAlertsTask.cs:line 0
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+14ms Processing

Server:
dw1sdwk000bbd:2732
Worker:
e6abd010
+25msForwardTranscriptAlertsTask - Started at 10/15/2025 11:03:17 AM
+52msFinding emails starting: 2025-09-05T11:03:17Z
+423msGetEmails: Total Email Message Count: 86
+1.660sGetEmails: Email Messages Collection Count: 86
+1.670sForwardTranscriptAlertsTask - Failed at 10/15/2025 11:03:18 AMIndex was outside the bounds of the array.

+1m 13.423s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 3 of 10: Index was outside the bounds of the array.

Enqueue at:
10/15/2025 11:03:04 AM

+1.624s Failed

An exception occurred during performance of the job.

System.IndexOutOfRangeException

Index was outside the bounds of the array.

System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at AG.A1.Scheduler.Project.Application.Features.TCSPitBull.ForwardTranscriptAlertsTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\TCSPitBull\ForwardTranscriptAlertsTask.cs:line 0
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+16ms Processing

Server:
dw1sdwk000bbd:2732
Worker:
9a687009
+24msForwardTranscriptAlertsTask - Started at 10/15/2025 11:02:01 AM
+57msFinding emails starting: 2025-09-05T11:02:01Z
+367msGetEmails: Total Email Message Count: 86
+1.597sGetEmails: Email Messages Collection Count: 86
+1.605sForwardTranscriptAlertsTask - Failed at 10/15/2025 11:02:03 AMIndex was outside the bounds of the array.

+58.107s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 2 of 10: Index was outside the bounds of the array.

Enqueue at:
10/15/2025 11:01:59 AM

+1.940s Failed

An exception occurred during performance of the job.

System.IndexOutOfRangeException

Index was outside the bounds of the array.

System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at AG.A1.Scheduler.Project.Application.Features.TCSPitBull.ForwardTranscriptAlertsTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\TCSPitBull\ForwardTranscriptAlertsTask.cs:line 0
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000bbd:2732
Worker:
e6abd010
+27msForwardTranscriptAlertsTask - Started at 10/15/2025 11:01:01 AM
+64msFinding emails starting: 2025-09-05T11:01:01Z
+412msGetEmails: Total Email Message Count: 86
+1.916sGetEmails: Email Messages Collection Count: 86
+1.922sForwardTranscriptAlertsTask - Failed at 10/15/2025 11:01:03 AMIndex was outside the bounds of the array.

+52.017s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 1 of 10: Index was outside the bounds of the array.

Enqueue at:
10/15/2025 11:00:53 AM

+3.887s Failed

An exception occurred during performance of the job.

System.IndexOutOfRangeException

Index was outside the bounds of the array.

System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at AG.A1.Scheduler.Project.Application.Features.TCSPitBull.ForwardTranscriptAlertsTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\TCSPitBull\ForwardTranscriptAlertsTask.cs:line 0
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+150ms Processing

Server:
dw1sdwk000bbd:2732
Worker:
3afc1fdf
+202msForwardTranscriptAlertsTask - Started at 10/15/2025 11:00:06 AM
+273msFinding emails starting: 2025-09-05T11:00:06Z
+1.535sGetEmails: Total Email Message Count: 86
+3.907sGetEmails: Email Messages Collection Count: 86
+3.915sForwardTranscriptAlertsTask - Failed at 10/15/2025 11:00:09 AMIndex was outside the bounds of the array.

+120ms Enqueued

Triggered by recurring job scheduler

Queue:
tcs-pitbull

10/15/2025 11:00:05 AM Created