[31.01.2025 00:05:11.898 +00:00 INF] 0HN9RK7EAAVCE:00000001 /api/Notification/ReceivedNotification/8d9e6ec4-2883-4671-a208-02728c29fef3 called [31.01.2025 00:05:12.156 +00:00 INF] 0HN9RK7EAAVCF:00000001 /api/Notification/ReceivedNotification/39de1dbb-131d-43da-8112-09115e963cdf called [31.01.2025 00:05:12.202 +00:00 INF] 0HN9RK7EAAVCE:00000001 ReceivedNotification - userId: 8d9e6ec4-2883-4671-a208-02728c29fef3 [31.01.2025 00:05:12.350 +00:00 INF] 0HN9RK7EAAVCF:00000001 ReceivedNotification - userId: 39de1dbb-131d-43da-8112-09115e963cdf [31.01.2025 07:21:47.118 +00:00 INF] 0HN9RK7EAAVCG:00000001 / called [31.01.2025 07:21:47.526 +00:00 INF] 0HN9RK7EAAVCG:00000002 /Images/ called [31.01.2025 07:21:48.105 +00:00 INF] 0HN9RK7EAAVCG:00000003 /invoices/ called [31.01.2025 07:21:48.506 +00:00 INF] 0HN9RK7EAAVCG:00000004 /Logs/ called [31.01.2025 07:21:49.084 +00:00 INF] 0HN9RK7EAAVCG:00000005 /Resources/ called [31.01.2025 11:20:17.889 +00:00 INF] 0HN9RK7EAAVCH:00000001 /api/SiteSetting/GetByNameAsync called [31.01.2025 11:20:17.910 +00:00 INF] 0HN9RK7EAAVCI:00000001 /api/ProductCategory/GetHierarchy called [31.01.2025 11:20:18.234 +00:00 INF] 0HN9RK7EAAVCI:00000002 /api/Order/GetAllByStatus called [31.01.2025 14:40:43.860 +00:00 INF] 0HN9RK7EAAVCJ:00000001 /api/ProductCategory/GetHierarchy called [31.01.2025 14:40:43.878 +00:00 INF] 0HN9RK7EAAVCK:00000001 /api/SiteSetting/GetByNameAsync called [31.01.2025 14:40:50.783 +00:00 ERR] 0HN9RK7EAAVCK:00000001 Api Error: 0HN9RK7EAAVCK:00000001 Microsoft.Azure.Cosmos.CosmosException : Response status code does not indicate success: RequestTimeout (408); Substatus: 0; ActivityId: 1d305706-d7db-409d-8959-aac52c7233b0; Reason: (Message: Request timed out. More info: https://aka.ms/cosmosdb-tsg-request-timeout ActivityId: 1d305706-d7db-409d-8959-aac52c7233b0, Request URI: /apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, RequestStats: Microsoft.Azure.Cosmos.Tracing.TraceData.ClientSideRequestStatisticsTraceDatum, SDK: Linux/12 cosmos-netstandard-sdk/3.32.0); ---> Microsoft.Azure.Documents.TransportException: A client transport error occurred: The request timed out while waiting for a server response. (Time: 2025-01-31T14:40:50.6210320Z, activity ID: 1d305706-d7db-409d-8959-aac52c7233b0, error code: ReceiveTimeout [0x0010], base error: HRESULT 0x80131500, URI: rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, connection: 169.254.136.2:53494 -> 20.15.14.14:14151, payload sent: True) at Microsoft.Azure.Documents.Rntbd.Channel.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats) at Microsoft.Azure.Documents.Rntbd.LoadBalancingPartition.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats) at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request) --- End of inner exception stack trace --- at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request) at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh) at Microsoft.Azure.Documents.StoreResult.VerifyCanContinueOnException(DocumentClientException ex) at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh) at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback) at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException) at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback) at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback) at Microsoft.Azure.Documents.ConsistencyWriter.WriteAsync(DocumentServiceRequest entity, TimeoutHelper timeout, Boolean forceRefresh, CancellationToken cancellationToken) at Microsoft.Azure.Documents.ReplicatedResourceClient.<>c__DisplayClass31_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback) at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException) at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback) at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback) at Microsoft.Azure.Documents.StoreClient.ProcessMessageAsync(DocumentServiceRequest request, CancellationToken cancellationToken, IRetryPolicy retryPolicy) at Microsoft.Azure.Cosmos.Handlers.TransportHandler.ProcessMessageAsync(RequestMessage request, CancellationToken cancellationToken) at Microsoft.Azure.Cosmos.Handlers.TransportHandler.SendAsync(RequestMessage request, CancellationToken cancellationToken) --- Cosmos Diagnostics ---{"Summary":{"DirectCalls":{"(408, 0)":1}},"name":"CreateItemAsync","start datetime":"2025-01-31T14:40:43.879Z","duration in milliseconds":6902.5492,"data":{"Client Configuration":{"Client Created Time Utc":"2025-01-23T11:34:08.4444219Z","MachineId":"hashedMachineName:29a32b8c-97d5-2e7d-2247-88c4ca67520d","NumberOfClientsCreated":1,"NumberOfActiveClients":1,"ConnectionMode":"Direct","User Agent":"cosmos-netstandard-sdk/3.38.1|1|X64|Debian GNU Linux 12 bookworm |.NET 9.0.0|N|","ConnectionConfig":{"gw":"(cps:50, urto:6, p:False, httpf: False)","rntbd":"(cto: 5, icto: -1, mrpc: 30, mcpe: 65535, erd: True, pr: ReuseUnicastPort)","other":"(ed:False, be:False)"},"ConsistencyConfig":"(consistency: NotSet, prgns:[], apprgn: )","ProcessorCount":4}},"children":[{"name":"ItemSerialize","duration in milliseconds":0.0194},{"name":"Microsoft.Azure.Cosmos.Handlers.RequestInvokerHandler","duration in milliseconds":6901.7284,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.DiagnosticsHandler","duration in milliseconds":6901.7133,"data":{"System Info":{"systemHistory":[{"dateUtc":"2025-01-31T14:39:57.5438717Z","cpu":3.219,"memory":1637892.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.048,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:07.5441365Z","cpu":16.011,"memory":1625540.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.1793,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:17.5443692Z","cpu":3.131,"memory":1649664.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0559,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:27.5446761Z","cpu":3.867,"memory":1647984.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.1177,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:37.5449505Z","cpu":3.347,"memory":1636556.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0594,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:47.5451739Z","cpu":4.603,"memory":1629232.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0499,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2}]}},"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.TelemetryHandler","duration in milliseconds":6901.6999,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.RetryHandler","duration in milliseconds":6901.6953,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.RouterHandler","duration in milliseconds":6885.2112,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.TransportHandler","duration in milliseconds":6885.2081,"children":[{"name":"Microsoft.Azure.Documents.ServerStoreModel Transport Request","duration in milliseconds":6770.0259,"data":{"Client Side Request Stats":{"Id":"AggregatedClientSideRequestStatistics","ContactedReplicas":[{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/"},{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14339/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133673731684002841s/"},{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14345/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133561959062918546s/"},{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14365/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133673111851422831s/"}],"RegionsContacted":[],"FailedReplicas":[],"AddressResolutionStatistics":[],"StoreResponseStatistics":[{"ResponseTimeUTC":"2025-01-31T14:40:50.6495682Z","ResourceType":"Document","OperationType":"Create","LocationEndpoint":"https://findin-dev-eastus2.documents.azure.com/","StoreResult":{"ActivityId":"1d305706-d7db-409d-8959-aac52c7233b0","StatusCode":"RequestTimeout","SubStatusCode":"Unknown","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 14151 | status: Connected | lkt: 01/30/2025 07:26:46)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2025-01-31T14:40:43.8802073Z", "durationInMs": 0.0023},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2025-01-31T14:40:43.8802096Z", "durationInMs": 0.0108},{"event": "Pipelined", "startTimeUtc": "2025-01-31T14:40:43.8802204Z", "durationInMs": 0.118},{"event": "Transit Time", "startTimeUtc": "2025-01-31T14:40:43.8803384Z", "durationInMs": 6740.7913},{"event": "Failed", "startTimeUtc": "2025-01-31T14:40:50.6211297Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":2,"openConnections":1},"connectionStats":{"waitforConnectionInit":"False","callsPendingReceive":1,"lastSendAttempt":"2025-01-31T14:40:43.8647696Z","lastSend":"2025-01-31T14:40:43.8648638Z","lastReceive":"2025-01-31T11:20:18.4284013Z"},"requestSizeInBytes":740,"requestBodySizeInBytes":311},"TransportException":"A client transport error occurred: The request timed out while waiting for a server response. (Time: 2025-01-31T14:40:50.6210320Z, activity ID: 1d305706-d7db-409d-8959-aac52c7233b0, error code: ReceiveTimeout [0x0010], base error: HRESULT 0x80131500, URI: rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, connection: 169.254.136.2:53494 -> 20.15.14.14:14151, payload sent: True)"}}]},"Point Operation Statistics":{"Id":"PointOperationStatistics","ActivityId":"1d305706-d7db-409d-8959-aac52c7233b0","ResponseTimeUtc":"2025-01-31T14:40:50.7642780Z","StatusCode":408,"SubStatusCode":0,"RequestCharge":0,"RequestUri":"dbs/SeriLogs/colls/Logs","ErrorMessage":"Microsoft.Azure.Documents.RequestTimeoutException: Message: Request timed out. More info: https://aka.ms/cosmosdb-tsg-request-timeout\nActivityId: 1d305706-d7db-409d-8959-aac52c7233b0, Request URI: /apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, RequestStats: Microsoft.Azure.Cosmos.Tracing.TraceData.ClientSideRequestStatisticsTraceDatum, SDK: Linux/12 cosmos-netstandard-sdk/3.32.0\n ---> Microsoft.Azure.Documents.TransportException: A client transport error occurred: The request timed out while waiting for a server response. (Time: 2025-01-31T14:40:50.6210320Z, activity ID: 1d305706-d7db-409d-8959-aac52c7233b0, error code: ReceiveTimeout [0x0010], base error: HRESULT 0x80131500, URI: rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, connection: 169.254.136.2:53494 -> 20.15.14.14:14151, payload sent: True)\n at Microsoft.Azure.Documents.Rntbd.Channel.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats)\n at Microsoft.Azure.Documents.Rntbd.LoadBalancingPartition.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats)\n at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request)\n --- End of inner exception stack trace ---\n at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request)\n at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh)\n at Microsoft.Azure.Documents.StoreResult.VerifyCanContinueOnException(DocumentClientException ex)\n at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh)\n at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)\n at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)\n at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)\n at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)\n at Microsoft.Azure.Documents.ConsistencyWriter.WriteAsync(DocumentServiceRequest entity, TimeoutHelper timeout, Boolean forceRefresh, CancellationToken cancellationToken)\n at Microsoft.Azure.Documents.ReplicatedResourceClient.<>c__DisplayClass31_0.<b__0>d.MoveNext()\n--- End of stack trace from previous location ---\n at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\n at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)\n at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\n at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\n at Microsoft.Azure.Documents.StoreClient.ProcessMessageAsync(DocumentServiceRequest request, CancellationToken cancellationToken, IRetryPolicy retryPolicy)\n at Microsoft.Azure.Cosmos.Handlers.TransportHandler.ProcessMessageAsync(RequestMessage request, CancellationToken cancellationToken)\n at Microsoft.Azure.Cosmos.Handlers.TransportHandler.SendAsync(RequestMessage request, CancellationToken cancellationToken)","RequestSessionToken":null,"ResponseSessionToken":null,"BELatencyInMs":null}}}]}]}]}]}]}]}]} [31.01.2025 14:40:50.783 +00:00 ERR] 0HN9RK7EAAVCJ:00000001 Api Error: 0HN9RK7EAAVCJ:00000001 Microsoft.Azure.Cosmos.CosmosException : Response status code does not indicate success: RequestTimeout (408); Substatus: 0; ActivityId: 3fa82edb-830b-4013-bdca-09a96730f23a; Reason: (Message: Request timed out. More info: https://aka.ms/cosmosdb-tsg-request-timeout ActivityId: 3fa82edb-830b-4013-bdca-09a96730f23a, Request URI: /apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, RequestStats: Microsoft.Azure.Cosmos.Tracing.TraceData.ClientSideRequestStatisticsTraceDatum, SDK: Linux/12 cosmos-netstandard-sdk/3.32.0); ---> Microsoft.Azure.Documents.TransportException: A client transport error occurred: The request timed out while waiting for a server response. (Time: 2025-01-31T14:40:50.6497578Z, activity ID: 3fa82edb-830b-4013-bdca-09a96730f23a, error code: ReceiveTimeout [0x0010], base error: HRESULT 0x80131500, URI: rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, connection: 169.254.136.2:53494 -> 20.15.14.14:14151, payload sent: True) at Microsoft.Azure.Documents.Rntbd.Channel.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats) at Microsoft.Azure.Documents.Rntbd.LoadBalancingPartition.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats) at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request) --- End of inner exception stack trace --- at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request) at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh) at Microsoft.Azure.Documents.StoreResult.VerifyCanContinueOnException(DocumentClientException ex) at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh) at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback) at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException) at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback) at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback) at Microsoft.Azure.Documents.ConsistencyWriter.WriteAsync(DocumentServiceRequest entity, TimeoutHelper timeout, Boolean forceRefresh, CancellationToken cancellationToken) at Microsoft.Azure.Documents.ReplicatedResourceClient.<>c__DisplayClass31_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback) at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException) at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback) at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback) at Microsoft.Azure.Documents.StoreClient.ProcessMessageAsync(DocumentServiceRequest request, CancellationToken cancellationToken, IRetryPolicy retryPolicy) at Microsoft.Azure.Cosmos.Handlers.TransportHandler.ProcessMessageAsync(RequestMessage request, CancellationToken cancellationToken) at Microsoft.Azure.Cosmos.Handlers.TransportHandler.SendAsync(RequestMessage request, CancellationToken cancellationToken) --- Cosmos Diagnostics ---{"Summary":{"DirectCalls":{"(408, 0)":1}},"name":"CreateItemAsync","start datetime":"2025-01-31T14:40:43.864Z","duration in milliseconds":6918.0226,"data":{"Client Configuration":{"Client Created Time Utc":"2025-01-23T11:34:08.4444219Z","MachineId":"hashedMachineName:29a32b8c-97d5-2e7d-2247-88c4ca67520d","NumberOfClientsCreated":1,"NumberOfActiveClients":1,"ConnectionMode":"Direct","User Agent":"cosmos-netstandard-sdk/3.38.1|1|X64|Debian GNU Linux 12 bookworm |.NET 9.0.0|N|","ConnectionConfig":{"gw":"(cps:50, urto:6, p:False, httpf: False)","rntbd":"(cto: 5, icto: -1, mrpc: 30, mcpe: 65535, erd: True, pr: ReuseUnicastPort)","other":"(ed:False, be:False)"},"ConsistencyConfig":"(consistency: NotSet, prgns:[], apprgn: )","ProcessorCount":4}},"children":[{"name":"ItemSerialize","duration in milliseconds":0.0202},{"name":"Microsoft.Azure.Cosmos.Handlers.RequestInvokerHandler","duration in milliseconds":6917.2026,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.DiagnosticsHandler","duration in milliseconds":6917.1835,"data":{"System Info":{"systemHistory":[{"dateUtc":"2025-01-31T14:39:57.5438717Z","cpu":3.219,"memory":1637892.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.048,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:07.5441365Z","cpu":16.011,"memory":1625540.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.1793,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:17.5443692Z","cpu":3.131,"memory":1649664.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0559,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:27.5446761Z","cpu":3.867,"memory":1647984.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.1177,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:37.5449505Z","cpu":3.347,"memory":1636556.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0594,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:47.5451739Z","cpu":4.603,"memory":1629232.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0499,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2}]}},"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.TelemetryHandler","duration in milliseconds":6917.1743,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.RetryHandler","duration in milliseconds":6917.1705,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.RouterHandler","duration in milliseconds":6900.6817,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.TransportHandler","duration in milliseconds":6900.6785,"children":[{"name":"Microsoft.Azure.Documents.ServerStoreModel Transport Request","duration in milliseconds":6785.4869,"data":{"Client Side Request Stats":{"Id":"AggregatedClientSideRequestStatistics","ContactedReplicas":[{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/"},{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14339/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133673731684002841s/"},{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14345/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133561959062918546s/"},{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14365/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133673111851422831s/"}],"RegionsContacted":[],"FailedReplicas":[],"AddressResolutionStatistics":[],"StoreResponseStatistics":[{"ResponseTimeUTC":"2025-01-31T14:40:50.6499833Z","ResourceType":"Document","OperationType":"Create","LocationEndpoint":"https://findin-dev-eastus2.documents.azure.com/","StoreResult":{"ActivityId":"3fa82edb-830b-4013-bdca-09a96730f23a","StatusCode":"RequestTimeout","SubStatusCode":"Unknown","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 14151 | status: Connected | lkt: 01/30/2025 07:26:46)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2025-01-31T14:40:43.8647190Z", "durationInMs": 0.0024},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2025-01-31T14:40:43.8647214Z", "durationInMs": 0.0129},{"event": "Pipelined", "startTimeUtc": "2025-01-31T14:40:43.8647343Z", "durationInMs": 0.1297},{"event": "Transit Time", "startTimeUtc": "2025-01-31T14:40:43.8648640Z", "durationInMs": 6784.93},{"event": "Failed", "startTimeUtc": "2025-01-31T14:40:50.6497940Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":1,"openConnections":1},"connectionStats":{"waitforConnectionInit":"False","callsPendingReceive":0,"lastSendAttempt":"2025-01-31T11:20:18.2353224Z","lastSend":"2025-01-31T11:20:18.2354349Z","lastReceive":"2025-01-31T11:20:18.4284013Z"},"requestSizeInBytes":744,"requestBodySizeInBytes":315},"TransportException":"A client transport error occurred: The request timed out while waiting for a server response. (Time: 2025-01-31T14:40:50.6497578Z, activity ID: 3fa82edb-830b-4013-bdca-09a96730f23a, error code: ReceiveTimeout [0x0010], base error: HRESULT 0x80131500, URI: rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, connection: 169.254.136.2:53494 -> 20.15.14.14:14151, payload sent: True)"}}]},"Point Operation Statistics":{"Id":"PointOperationStatistics","ActivityId":"3fa82edb-830b-4013-bdca-09a96730f23a","ResponseTimeUtc":"2025-01-31T14:40:50.7642861Z","StatusCode":408,"SubStatusCode":0,"RequestCharge":0,"RequestUri":"dbs/SeriLogs/colls/Logs","ErrorMessage":"Microsoft.Azure.Documents.RequestTimeoutException: Message: Request timed out. More info: https://aka.ms/cosmosdb-tsg-request-timeout\nActivityId: 3fa82edb-830b-4013-bdca-09a96730f23a, Request URI: /apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, RequestStats: Microsoft.Azure.Cosmos.Tracing.TraceData.ClientSideRequestStatisticsTraceDatum, SDK: Linux/12 cosmos-netstandard-sdk/3.32.0\n ---> Microsoft.Azure.Documents.TransportException: A client transport error occurred: The request timed out while waiting for a server response. (Time: 2025-01-31T14:40:50.6497578Z, activity ID: 3fa82edb-830b-4013-bdca-09a96730f23a, error code: ReceiveTimeout [0x0010], base error: HRESULT 0x80131500, URI: rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, connection: 169.254.136.2:53494 -> 20.15.14.14:14151, payload sent: True)\n at Microsoft.Azure.Documents.Rntbd.Channel.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats)\n at Microsoft.Azure.Documents.Rntbd.LoadBalancingPartition.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats)\n at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request)\n --- End of inner exception stack trace ---\n at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request)\n at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh)\n at Microsoft.Azure.Documents.StoreResult.VerifyCanContinueOnException(DocumentClientException ex)\n at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh)\n at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)\n at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)\n at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)\n at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)\n at Microsoft.Azure.Documents.ConsistencyWriter.WriteAsync(DocumentServiceRequest entity, TimeoutHelper timeout, Boolean forceRefresh, CancellationToken cancellationToken)\n at Microsoft.Azure.Documents.ReplicatedResourceClient.<>c__DisplayClass31_0.<b__0>d.MoveNext()\n--- End of stack trace from previous location ---\n at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\n at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)\n at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\n at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\n at Microsoft.Azure.Documents.StoreClient.ProcessMessageAsync(DocumentServiceRequest request, CancellationToken cancellationToken, IRetryPolicy retryPolicy)\n at Microsoft.Azure.Cosmos.Handlers.TransportHandler.ProcessMessageAsync(RequestMessage request, CancellationToken cancellationToken)\n at Microsoft.Azure.Cosmos.Handlers.TransportHandler.SendAsync(RequestMessage request, CancellationToken cancellationToken)","RequestSessionToken":null,"ResponseSessionToken":null,"BELatencyInMs":null}}}]}]}]}]}]}]}]} [31.01.2025 14:40:50.895 +00:00 ERR] 0HN9RK7EAAVCK:00000001 An unhandled exception has occurred while executing the request. Newtonsoft.Json.JsonSerializationException: Self referencing loop detected for property 'Parent' with type 'Microsoft.Azure.Cosmos.Tracing.Trace'. Path 'Diagnostics.Value.Children[0]'. at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.CheckForCircularReference(JsonWriter writer, Object value, JsonProperty property, JsonContract contract, JsonContainerContract containerContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeList(JsonWriter writer, IEnumerable values, JsonArrayContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.Serialize(JsonWriter jsonWriter, Object value, Type objectType) at Newtonsoft.Json.JsonSerializer.SerializeInternal(JsonWriter jsonWriter, Object value, Type objectType) at Newtonsoft.Json.JsonConvert.SerializeObjectInternal(Object value, Type type, JsonSerializer jsonSerializer) at Service.Integrations.Logging.LoggerAdapter`1.LogErrorAsync(Exception exception, String message, Object[] args) in /home/runner/work/FindIn.Api/FindIn.Api/Api/Service/Integrations/Logging/LoggerAdapter.cs:line 26 at Api.Infrastructure.Middlewares.ExceptionHandlerMiddleware.Invoke(HttpContext context, IAppLogger`1 logger) in /home/runner/work/FindIn.Api/FindIn.Api/Api/Api/Infrastructure/Middlewares/ExceptionHandlerMiddleware.cs:line 27 at Swashbuckle.AspNetCore.SwaggerUI.SwaggerUIMiddleware.Invoke(HttpContext httpContext) at Swashbuckle.AspNetCore.Swagger.SwaggerMiddleware.Invoke(HttpContext httpContext, ISwaggerProvider swaggerProvider) at Microsoft.AspNetCore.Diagnostics.DeveloperExceptionPageMiddlewareImpl.Invoke(HttpContext context) [31.01.2025 14:40:50.895 +00:00 ERR] 0HN9RK7EAAVCJ:00000001 An unhandled exception has occurred while executing the request. Newtonsoft.Json.JsonSerializationException: Self referencing loop detected for property 'Parent' with type 'Microsoft.Azure.Cosmos.Tracing.Trace'. Path 'Diagnostics.Value.Children[0]'. at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.CheckForCircularReference(JsonWriter writer, Object value, JsonProperty property, JsonContract contract, JsonContainerContract containerContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeList(JsonWriter writer, IEnumerable values, JsonArrayContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.Serialize(JsonWriter jsonWriter, Object value, Type objectType) at Newtonsoft.Json.JsonSerializer.SerializeInternal(JsonWriter jsonWriter, Object value, Type objectType) at Newtonsoft.Json.JsonConvert.SerializeObjectInternal(Object value, Type type, JsonSerializer jsonSerializer) at Service.Integrations.Logging.LoggerAdapter`1.LogErrorAsync(Exception exception, String message, Object[] args) in /home/runner/work/FindIn.Api/FindIn.Api/Api/Service/Integrations/Logging/LoggerAdapter.cs:line 26 at Api.Infrastructure.Middlewares.ExceptionHandlerMiddleware.Invoke(HttpContext context, IAppLogger`1 logger) in /home/runner/work/FindIn.Api/FindIn.Api/Api/Api/Infrastructure/Middlewares/ExceptionHandlerMiddleware.cs:line 27 at Swashbuckle.AspNetCore.SwaggerUI.SwaggerUIMiddleware.Invoke(HttpContext httpContext) at Swashbuckle.AspNetCore.Swagger.SwaggerMiddleware.Invoke(HttpContext httpContext, ISwaggerProvider swaggerProvider) at Microsoft.AspNetCore.Diagnostics.DeveloperExceptionPageMiddlewareImpl.Invoke(HttpContext context) [31.01.2025 14:40:52.308 +00:00 INF] 0HN9RK7EAAVCK:00000002 /api/ProductCategory/GetHierarchy called [31.01.2025 14:40:58.618 +00:00 ERR] 0HN9RK7EAAVCK:00000002 Api Error: 0HN9RK7EAAVCK:00000002 Microsoft.Azure.Cosmos.CosmosException : Response status code does not indicate success: RequestTimeout (408); Substatus: 0; ActivityId: 725e2f47-206f-42d3-88a4-08c8cf3c2d72; Reason: (Message: Request timed out. More info: https://aka.ms/cosmosdb-tsg-request-timeout ActivityId: 725e2f47-206f-42d3-88a4-08c8cf3c2d72, Request URI: /apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, RequestStats: Microsoft.Azure.Cosmos.Tracing.TraceData.ClientSideRequestStatisticsTraceDatum, SDK: Linux/12 cosmos-netstandard-sdk/3.32.0); ---> Microsoft.Azure.Documents.TransportException: A client transport error occurred: The request timed out while waiting for a server response. (Time: 2025-01-31T14:40:58.6162541Z, activity ID: 725e2f47-206f-42d3-88a4-08c8cf3c2d72, error code: ReceiveTimeout [0x0010], base error: HRESULT 0x80131500, URI: rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, connection: 169.254.136.2:53494 -> 20.15.14.14:14151, payload sent: True) at Microsoft.Azure.Documents.Rntbd.Channel.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats) at Microsoft.Azure.Documents.Rntbd.LoadBalancingPartition.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats) at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request) --- End of inner exception stack trace --- at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request) at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh) at Microsoft.Azure.Documents.StoreResult.VerifyCanContinueOnException(DocumentClientException ex) at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh) at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback) at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException) at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback) at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback) at Microsoft.Azure.Documents.ConsistencyWriter.WriteAsync(DocumentServiceRequest entity, TimeoutHelper timeout, Boolean forceRefresh, CancellationToken cancellationToken) at Microsoft.Azure.Documents.ReplicatedResourceClient.<>c__DisplayClass31_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback) at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException) at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback) at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback) at Microsoft.Azure.Documents.StoreClient.ProcessMessageAsync(DocumentServiceRequest request, CancellationToken cancellationToken, IRetryPolicy retryPolicy) at Microsoft.Azure.Cosmos.Handlers.TransportHandler.ProcessMessageAsync(RequestMessage request, CancellationToken cancellationToken) at Microsoft.Azure.Cosmos.Handlers.TransportHandler.SendAsync(RequestMessage request, CancellationToken cancellationToken) --- Cosmos Diagnostics ---{"Summary":{"DirectCalls":{"(408, 0)":1}},"name":"CreateItemAsync","start datetime":"2025-01-31T14:40:52.309Z","duration in milliseconds":6309.2571,"data":{"Client Configuration":{"Client Created Time Utc":"2025-01-23T11:34:08.4444219Z","MachineId":"hashedMachineName:29a32b8c-97d5-2e7d-2247-88c4ca67520d","NumberOfClientsCreated":1,"NumberOfActiveClients":1,"ConnectionMode":"Direct","User Agent":"cosmos-netstandard-sdk/3.38.1|1|X64|Debian GNU Linux 12 bookworm |.NET 9.0.0|N|","ConnectionConfig":{"gw":"(cps:50, urto:6, p:False, httpf: False)","rntbd":"(cto: 5, icto: -1, mrpc: 30, mcpe: 65535, erd: True, pr: ReuseUnicastPort)","other":"(ed:False, be:False)"},"ConsistencyConfig":"(consistency: NotSet, prgns:[], apprgn: )","ProcessorCount":4}},"children":[{"name":"ItemSerialize","duration in milliseconds":0.0239},{"name":"Microsoft.Azure.Cosmos.Handlers.RequestInvokerHandler","duration in milliseconds":6308.7578,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.DiagnosticsHandler","duration in milliseconds":6308.7365,"data":{"System Info":{"systemHistory":[{"dateUtc":"2025-01-31T14:40:07.5441365Z","cpu":16.011,"memory":1625540.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.1793,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:17.5443692Z","cpu":3.131,"memory":1649664.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0559,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:27.5446761Z","cpu":3.867,"memory":1647984.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.1177,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:37.5449505Z","cpu":3.347,"memory":1636556.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0594,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:47.5451739Z","cpu":4.603,"memory":1629232.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0499,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2},{"dateUtc":"2025-01-31T14:40:57.5454259Z","cpu":5.224,"memory":1642892.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0483,"availableThreads":32766,"minThreads":4,"maxThreads":32767},"numberOfOpenTcpConnection":2}]}},"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.TelemetryHandler","duration in milliseconds":6308.7279,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.RetryHandler","duration in milliseconds":6308.7237,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.RouterHandler","duration in milliseconds":6308.5832,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.TransportHandler","duration in milliseconds":6308.5802,"children":[{"name":"Microsoft.Azure.Documents.ServerStoreModel Transport Request","duration in milliseconds":6307.6165,"data":{"Client Side Request Stats":{"Id":"AggregatedClientSideRequestStatistics","ContactedReplicas":[{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/"},{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14339/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133673731684002841s/"},{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14345/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133561959062918546s/"},{"Count":1,"Uri":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14365/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133673111851422831s/"}],"RegionsContacted":[],"FailedReplicas":[],"AddressResolutionStatistics":[],"StoreResponseStatistics":[{"ResponseTimeUTC":"2025-01-31T14:40:58.6169867Z","ResourceType":"Document","OperationType":"Create","LocationEndpoint":"https://findin-dev-eastus2.documents.azure.com/","StoreResult":{"ActivityId":"725e2f47-206f-42d3-88a4-08c8cf3c2d72","StatusCode":"RequestTimeout","SubStatusCode":"Unknown","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 14151 | status: Connected | lkt: 01/30/2025 07:26:46)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2025-01-31T14:40:52.3097365Z", "durationInMs": 0.0024},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2025-01-31T14:40:52.3097389Z", "durationInMs": 0.0119},{"event": "Pipelined", "startTimeUtc": "2025-01-31T14:40:52.3097508Z", "durationInMs": 0.0873},{"event": "Transit Time", "startTimeUtc": "2025-01-31T14:40:52.3098381Z", "durationInMs": 6306.7884},{"event": "Failed", "startTimeUtc": "2025-01-31T14:40:58.6166265Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":1,"openConnections":1},"connectionStats":{"waitforConnectionInit":"False","callsPendingReceive":0,"lastSendAttempt":"2025-01-31T14:40:43.8802525Z","lastSend":"2025-01-31T14:40:43.8803382Z","lastReceive":"2025-01-31T11:20:18.4284013Z"},"requestSizeInBytes":744,"requestBodySizeInBytes":315},"TransportException":"A client transport error occurred: The request timed out while waiting for a server response. (Time: 2025-01-31T14:40:58.6162541Z, activity ID: 725e2f47-206f-42d3-88a4-08c8cf3c2d72, error code: ReceiveTimeout [0x0010], base error: HRESULT 0x80131500, URI: rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, connection: 169.254.136.2:53494 -> 20.15.14.14:14151, payload sent: True)"}}]},"Point Operation Statistics":{"Id":"PointOperationStatistics","ActivityId":"725e2f47-206f-42d3-88a4-08c8cf3c2d72","ResponseTimeUtc":"2025-01-31T14:40:58.6178270Z","StatusCode":408,"SubStatusCode":0,"RequestCharge":0,"RequestUri":"dbs/SeriLogs/colls/Logs","ErrorMessage":"Microsoft.Azure.Documents.RequestTimeoutException: Message: Request timed out. More info: https://aka.ms/cosmosdb-tsg-request-timeout\nActivityId: 725e2f47-206f-42d3-88a4-08c8cf3c2d72, Request URI: /apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, RequestStats: Microsoft.Azure.Cosmos.Tracing.TraceData.ClientSideRequestStatisticsTraceDatum, SDK: Linux/12 cosmos-netstandard-sdk/3.32.0\n ---> Microsoft.Azure.Documents.TransportException: A client transport error occurred: The request timed out while waiting for a server response. (Time: 2025-01-31T14:40:58.6162541Z, activity ID: 725e2f47-206f-42d3-88a4-08c8cf3c2d72, error code: ReceiveTimeout [0x0010], base error: HRESULT 0x80131500, URI: rntbd://cdb-ms-prod-eastus2-be94.documents.azure.com:14151/apps/5679bb00-dcaf-4918-be82-fa4dc8b7c8c2/services/69cf0dd8-006d-4094-895a-1684ed696c74/partitions/16975545-b539-4c5c-ad9c-be5d2cc7a3db/replicas/133742344664025022p/, connection: 169.254.136.2:53494 -> 20.15.14.14:14151, payload sent: True)\n at Microsoft.Azure.Documents.Rntbd.Channel.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats)\n at Microsoft.Azure.Documents.Rntbd.LoadBalancingPartition.RequestAsync(DocumentServiceRequest request, TransportAddressUri physicalAddress, ResourceOperation resourceOperation, Guid activityId, TransportRequestStats transportRequestStats)\n at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request)\n --- End of inner exception stack trace ---\n at Microsoft.Azure.Documents.Rntbd.TransportClient.InvokeStoreAsync(TransportAddressUri physicalAddress, ResourceOperation resourceOperation, DocumentServiceRequest request)\n at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh)\n at Microsoft.Azure.Documents.StoreResult.VerifyCanContinueOnException(DocumentClientException ex)\n at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh)\n at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)\n at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)\n at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)\n at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync[TParam,TPolicy](Func`1 callbackMethod, Func`3 callbackMethodWithParam, Func`2 callbackMethodWithPolicy, TParam param, IRetryPolicy retryPolicy, IRetryPolicy`1 retryPolicyWithArg, Func`1 inBackoffAlternateCallbackMethod, Func`2 inBackoffAlternateCallbackMethodWithPolicy, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)\n at Microsoft.Azure.Documents.ConsistencyWriter.WriteAsync(DocumentServiceRequest entity, TimeoutHelper timeout, Boolean forceRefresh, CancellationToken cancellationToken)\n at Microsoft.Azure.Documents.ReplicatedResourceClient.<>c__DisplayClass31_0.<b__0>d.MoveNext()\n--- End of stack trace from previous location ---\n at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\n at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)\n at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\n at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\n at Microsoft.Azure.Documents.StoreClient.ProcessMessageAsync(DocumentServiceRequest request, CancellationToken cancellationToken, IRetryPolicy retryPolicy)\n at Microsoft.Azure.Cosmos.Handlers.TransportHandler.ProcessMessageAsync(RequestMessage request, CancellationToken cancellationToken)\n at Microsoft.Azure.Cosmos.Handlers.TransportHandler.SendAsync(RequestMessage request, CancellationToken cancellationToken)","RequestSessionToken":null,"ResponseSessionToken":null,"BELatencyInMs":null}}}]}]}]}]}]}]}]} [31.01.2025 14:40:58.621 +00:00 ERR] 0HN9RK7EAAVCK:00000002 An unhandled exception has occurred while executing the request. Newtonsoft.Json.JsonSerializationException: Self referencing loop detected for property 'Parent' with type 'Microsoft.Azure.Cosmos.Tracing.Trace'. Path 'Diagnostics.Value.Children[0]'. at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.CheckForCircularReference(JsonWriter writer, Object value, JsonProperty property, JsonContract contract, JsonContainerContract containerContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeList(JsonWriter writer, IEnumerable values, JsonArrayContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.Serialize(JsonWriter jsonWriter, Object value, Type objectType) at Newtonsoft.Json.JsonSerializer.SerializeInternal(JsonWriter jsonWriter, Object value, Type objectType) at Newtonsoft.Json.JsonConvert.SerializeObjectInternal(Object value, Type type, JsonSerializer jsonSerializer) at Service.Integrations.Logging.LoggerAdapter`1.LogErrorAsync(Exception exception, String message, Object[] args) in /home/runner/work/FindIn.Api/FindIn.Api/Api/Service/Integrations/Logging/LoggerAdapter.cs:line 26 at Api.Infrastructure.Middlewares.ExceptionHandlerMiddleware.Invoke(HttpContext context, IAppLogger`1 logger) in /home/runner/work/FindIn.Api/FindIn.Api/Api/Api/Infrastructure/Middlewares/ExceptionHandlerMiddleware.cs:line 27 at Swashbuckle.AspNetCore.SwaggerUI.SwaggerUIMiddleware.Invoke(HttpContext httpContext) at Swashbuckle.AspNetCore.Swagger.SwaggerMiddleware.Invoke(HttpContext httpContext, ISwaggerProvider swaggerProvider) at Microsoft.AspNetCore.Diagnostics.DeveloperExceptionPageMiddlewareImpl.Invoke(HttpContext context) [31.01.2025 15:05:57.020 +00:00 INF] 0HN9RK7EAAVCL:00000001 /favicon.ico called [31.01.2025 15:46:32.927 +00:00 INF] 0HN9RK7EAAVCM:00000001 / called [31.01.2025 15:46:33.328 +00:00 INF] 0HN9RK7EAAVCM:00000002 /Images/ called [31.01.2025 15:46:33.976 +00:00 INF] 0HN9RK7EAAVCM:00000003 /invoices/ called [31.01.2025 15:46:34.367 +00:00 INF] 0HN9RK7EAAVCM:00000004 /Logs/ called [31.01.2025 15:46:34.958 +00:00 INF] 0HN9RK7EAAVCM:00000005 /Resources/ called [31.01.2025 19:39:42.023 +00:00 INF] 0HN9RK7EAAVCN:00000001 /api/ProductCategory/GetHierarchy called [31.01.2025 19:39:42.033 +00:00 INF] 0HN9RK7EAAVCO:00000001 /api/SiteSetting/GetByNameAsync called [31.01.2025 19:39:42.371 +00:00 INF] 0HN9RK7EAAVCO:00000002 /api/Order/GetAllByStatus called