Failed to load contents. Please reload

andrewsgreatstate · June 5, 2020, 3:03pm

I have…

[x] Checked the logs and have provided the logs if I found something suspicious there

I’m submitting a…

[ ] Regression (a behavior that stopped working in a new release)
[x] Bug report
[ ] Performance issue
[ ] Documentation issue or request

Current behavior

When searching against certain content, the search will not complete, and there will be a red message, “Failed to load contents. Please reload.”

Expected behavior

The search would complete.

Minimal reproduction of the problem

Enter a search term in the search bar.

Environment

[ ] Self hosted with docker
[ ] Self hosted with IIS
[x] Self hosted with other version - CloudFoundry
[ ] Cloud version

Version: 4.1.0

Browser:

[ x] Chrome (desktop)
[ ] Chrome (Android)
[ ] Chrome (iOS)
[ ] Firefox
[ ] Safari (desktop)
[ ] Safari (iOS)
[ ] IE
[ ] Edge

Others:

In Chrome tools, there is an error:
VM8:1 GET https://mod-squidex-uat.cloudapps.digital/api/content/modbenefitscalculatoruat/benefit?q={"fullText"%3A"test"%2C"take"%3A10%2C"sort"%3A[]%2C"filter"%3A{"and"%3A[]}} 500 (Internal Server Error)

In the logs, there are two instances of null reference errors that show up:
“Lifecycle start canceled due to errors at stage 2000”
and
"“Error calling grain\u0027s OnActivateAsync() method”

I’m unsure if the warning of Unreleased index is relevant, but I’ve included that log.
Relevant logs:
editing logs…will paste in here shortly…the format was messed up…

Sebastian · June 5, 2020, 3:07pm

Seems to be a problem with full text index only. You can go to administration and then event consumers and restart the indexer or make a backup of your mongo DB and send it to me.

andrewsgreatstate · June 5, 2020, 3:27pm

I’ll take a look at restarting the indexer first. Let me check the size of the mongodb.

andrewsgreatstate · June 5, 2020, 3:30pm

Okay, restarting the text indexer - TextIndexer2 in the consumers - didn’t seem to solve the issue. The logs are sort of annoyingly formatted, so I haven’t pasted in here. Is there a way to submit text files, as that would be easier for you to parse.

andrewsgreatstate · June 5, 2020, 3:32pm

The mongodb for this squidex index looks like it’s 4.53 gb in size…what would be the best way to send that to you?

Sebastian · June 5, 2020, 3:34pm

Use mongodump --archive, upload it to somewhere and send me the link. You can do the same with the log.

Sebastian · June 5, 2020, 3:46pm

Juse use code blocks for the log

But thank you very much for putting so much attention in it to format it properly.

andrewsgreatstate · June 5, 2020, 3:49pm

Here’s the log with the relevant info around the warnings and error.

 [RTR/8] OUT mod-squidex-uat.cloudapps.digital - [2020-06-05T13:52:07.311389892Z] "GET     /api/content/modbenefitscalculatoruat/option?q=%7B%22take%22%3A10%2C%22skip%22%3A90%2C%22sort%22%3A%5B%5D%2C%22filter%22%3A%7B%22and%22%3A%5B%5D%7D%7D HTTP/1.1" 304 0 0 "https://mod-squidex-uat.cloudapps.digital/app/modbenefitscalculatoruat/content/question/new" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36" "10.0.2.191:37122" "10.0.34.13:61022" x_forwarded_for:"77.97.237.160, 10.0.2.191" x_forwarded_proto:"https" vcap_request_id:"7d7d613a-5014-41e1-562b-7af76e610c91" response_time:0.027505 gorouter_time:0.000233 app_id:"5e5b43ed-fcee-41e2-916b-8f746fffef8d" app_index:"0" x_b3_traceid:"fb6c1361ffd1ea96" x_b3_spanid:"fb6c1361ffd1ea96" x_b3_parentspanid:"-" b3:"fb6c1361ffd1ea96-fb6c1361ffd1ea96"
   [RTR/8] OUT 
   {
     "logLevel": "Warning",
     "message": "Unreleased index found.",
     "schemaId": "eb9a1098-800e-4c96-933b-e0e12f7f0ed8",
     "app": {
       "name": "Squidex",
       "version": "4.1.0.0",
       "sessionId": "f838b25a-fe66-4a23-907c-c1493a86e52f"
     },
     "web": {
       "requestId": "|2502ab5a-4def4be09e128cd5.",
       "requestPath": "/content/modbenefitscalculatoruat/benefit",
       "requestMethod": "GET",
       "routeValues": {
         "area": "Api",
         "action": "GetContents",
         "controller": "Contents"
       }
     },
     "timestamp": "2020-06-05T13:52:07Z"
   }
   {
     "logLevel": "Error",
     "message": "Lifecycle start canceled due to errors at stage 2000: System.NullReferenceException: Object reference not set to an instance of an object.\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.CommitInternalAsync(IIndex index, Boolean dispose) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 116\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.AcquireAsync(Guid schemaId) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 60\n   at Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain.OnActivateAsync(Guid key) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/TextIndexerGrain.cs:line 54\n   at Squidex.Infrastructure.Orleans.GrainOfGuid.ActivateAsync(Guid key) in /src/src/Squidex.Infrastructure/Orleans/GrainOfGuid.cs:line 39\n   at Orleans.LifecycleSubject.\u003COnStart\u003Eg__CallOnStart|7_0(Int32 stage, OrderedObserver observer, CancellationToken cancellationToken)\n   at Orleans.LifecycleSubject.OnStart(CancellationToken ct)",
     "eventId": {
       "id": 100450
     },
     "stage": "2000",
     "exception": "System.NullReferenceException: Object reference not set to an instance of an object.\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.CommitInternalAsync(IIndex index, Boolean dispose) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 116\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.AcquireAsync(Guid schemaId) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 60\n   at Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain.OnActivateAsync(Guid key) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/TextIndexerGrain.cs:line 54\n   at Squidex.Infrastructure.Orleans.GrainOfGuid.ActivateAsync(Guid key) in /src/src/Squidex.Infrastructure/Orleans/GrainOfGuid.cs:line 39\n   at Orleans.LifecycleSubject.\u003COnStart\u003Eg__CallOnStart|7_0(Int32 stage, OrderedObserver observer, CancellationToken cancellationToken)\n   at Orleans.LifecycleSubject.OnStart(CancellationToken ct)",
     "app": {
       "name": "Squidex",
       "version": "4.1.0.0",
       "sessionId": "f838b25a-fe66-4a23-907c-c1493a86e52f"
     },
     "web": {
       "requestId": "|2502ab5a-4def4be09e128cd5.",
       "requestPath": "/content/modbenefitscalculatoruat/benefit",
       "requestMethod": "GET",
       "routeValues": {
         "area": "Api",
         "action": "GetContents",
         "controller": "Contents"
       }
     },
     "timestamp": "2020-06-05T13:52:07Z",
     "category": "Orleans.LifecycleSubject"
   }
   {
     "logLevel": "Error",
     "message": "Error calling grain\u0027s OnActivateAsync() method - Grain type = Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain Activation = [Activation: S127.0.0.1:11111:329059910*grn/9CEA1225/e1e03b93@5fa292bd #GrainType=Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain Placement=RandomPlacement State=Activating]",
     "eventId": {
       "id": 100513
     },
     "exception": {
       "type": "System.NullReferenceException",
       "message": "Object reference not set to an instance of an object.",
       "stackTrace": "   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.CommitInternalAsync(IIndex index, Boolean dispose) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 116\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.AcquireAsync(Guid schemaId) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 60\n   at Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain.OnActivateAsync(Guid key) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/TextIndexerGrain.cs:line 54\n   at Squidex.Infrastructure.Orleans.GrainOfGuid.ActivateAsync(Guid key) in /src/src/Squidex.Infrastructure/Orleans/GrainOfGuid.cs:line 39\n   at Orleans.LifecycleSubject.\u003COnStart\u003Eg__CallOnStart|7_0(Int32 stage, OrderedObserver observer, CancellationToken cancellationToken)\n   at Orleans.LifecycleSubject.OnStart(CancellationToken ct)\n   at Orleans.Runtime.Catalog.CallGrainActivate(ActivationData activation, Dictionary\u00602 requestContextData)"
     },
     "app": {
       "name": "Squidex",
       "version": "4.1.0.0",
       "sessionId": "f838b25a-fe66-4a23-907c-c1493a86e52f"
     },
     "web": {
       "requestId": "|2502ab5a-4def4be09e128cd5.",
       "requestPath": "/content/modbenefitscalculatoruat/benefit",
       "requestMethod": "GET",
       "routeValues": {
         "area": "Api",
         "action": "GetContents",
         "controller": "Contents"
       }
     },
     "timestamp": "2020-06-05T13:52:07Z",
     "category": "Orleans.Runtime.Catalog"
   }
   {
     "logLevel": "Warning",
     "message": "Failed to InvokeActivate for [Activation: S127.0.0.1:11111:329059910*grn/9CEA1225/e1e03b93@5fa292bd #GrainType=Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain Placement=RandomPlacement State=FailedToActivate].",
     "eventId": {
       "id": 100534
     },
     "exception": {
       "type": "System.NullReferenceException",
       "message": "Object reference not set to an instance of an object.",
       "stackTrace": "   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.CommitInternalAsync(IIndex index, Boolean dispose) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 116\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.AcquireAsync(Guid schemaId) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 60\n   at Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain.OnActivateAsync(Guid key) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/TextIndexerGrain.cs:line 54\n   at Squidex.Infrastructure.Orleans.GrainOfGuid.ActivateAsync(Guid key) in /src/src/Squidex.Infrastructure/Orleans/GrainOfGuid.cs:line 39\n   at Orleans.LifecycleSubject.\u003COnStart\u003Eg__CallOnStart|7_0(Int32 stage, OrderedObserver observer, CancellationToken cancellationToken)\n   at Orleans.LifecycleSubject.OnStart(CancellationToken ct)\n   at Orleans.Runtime.Catalog.CallGrainActivate(ActivationData activation, Dictionary\u00602 requestContextData)\n   at Orleans.Runtime.Scheduler.AsyncClosureWorkItem.Execute()\n   at Orleans.Runtime.Catalog.InitActivation(ActivationData activation, String grainType, String genericArguments, Dictionary\u00602 requestContextData)"
     },
     "app": {
       "name": "Squidex",
       "version": "4.1.0.0",
       "sessionId": "f838b25a-fe66-4a23-907c-c1493a86e52f"
     },
     "web": {
       "requestId": "|2502ab5a-4def4be09e128cd5.",
       "requestPath": "/content/modbenefitscalculatoruat/benefit",
       "requestMethod": "GET",
       "routeValues": {
         "area": "Api",
         "action": "GetContents",
         "controller": "Contents"
       }
     },
     "timestamp": "2020-06-05T13:52:07Z",
     "category": "Orleans.Runtime.Catalog"
   }

Sebastian · June 5, 2020, 3:50pm

Yes, the NullRef is definitely the reason. But it only affects the full text search. Other queries should still work fine.

andrewsgreatstate · June 5, 2020, 3:52pm

Is there a way to fix the error so the full text search doesn’t error out?

Sebastian · June 5, 2020, 3:56pm

Very likely but I need the backup for that.

andrewsgreatstate · June 5, 2020, 3:57pm

Okay, thanks…i’ll get back to you. Need to ensure it’s fine to send you the backup, as well as do the backup.

Thanks for the help so far!

Sebastian · June 5, 2020, 4:41pm

Btw: Do you have an environment with multiple instances?

andrewsgreatstate · June 8, 2020, 10:36am

If you mean multiple applications within a single Squidex instance, then in the development environment, we do. In this environment, we do not as of yet, but that was the plan - host two applications within the same Squidex environment.

If you mean a load balanced environment with one front end and two squidex behind the load balancer, that isn’t the case.

Just waiting on the OK for the database backup.

Sebastian · June 8, 2020, 12:14pm

I mean multiple SQuide nodes

andrewsgreatstate · June 9, 2020, 6:53am

Just a quick check - I assume the TextIndexer is supposed to stay running? When I restart/start, it doesn’t seem to continue to run.

andrewsgreatstate · June 9, 2020, 7:00am

Yeah, on attempting activation, I see the logs reporting activation failure.
Unreleased index found?

2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "logLevel": "Warning",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "message": "Unreleased index found.",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "schemaId": "6d262110-2306-449b-a683-7a6d62e55823",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "app": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "name": "Squidex",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "version": "4.1.0.0",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "sessionId": "f838b25a-fe66-4a23-907c-c1493a86e52f"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "timestamp": "2020-06-09T06:56:34Z"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT }
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "logLevel": "Error",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "message": "Lifecycle start canceled due to errors at stage 2000: System.NullReferenceException: Object reference not set to an instance of an object.\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.CommitInternalAsync(IIndex index, Boolean dispose) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 118\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.AcquireAsync(Guid schemaId) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 73\n   at Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain.OnActivateAsync(Guid key) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/TextIndexerGrain.cs:line 57\n   at Squidex.Infrastructure.Orleans.GrainOfGuid.ActivateAsync(Guid key) in /src/src/Squidex.Infrastructure/Orleans/GrainOfGuid.cs:line 40\n   at Orleans.LifecycleSubject.\u003COnStart\u003Eg__CallOnStart|7_0(Int32 stage, OrderedObserver observer, CancellationToken cancellationToken)\n   at Orleans.LifecycleSubject.OnStart(CancellationToken ct)",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "eventId": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "id": 100450
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "stage": "2000",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "exception": "System.NullReferenceException: Object reference not set to an instance of an object.\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.CommitInternalAsync(IIndex index, Boolean dispose) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 118\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.AcquireAsync(Guid schemaId) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 73\n   at Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain.OnActivateAsync(Guid key) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/TextIndexerGrain.cs:line 57\n   at Squidex.Infrastructure.Orleans.GrainOfGuid.ActivateAsync(Guid key) in /src/src/Squidex.Infrastructure/Orleans/GrainOfGuid.cs:line 40\n   at Orleans.LifecycleSubject.\u003COnStart\u003Eg__CallOnStart|7_0(Int32 stage, OrderedObserver observer, CancellationToken cancellationToken)\n   at Orleans.LifecycleSubject.OnStart(CancellationToken ct)",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "app": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "name": "Squidex",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "version": "4.1.0.0",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "sessionId": "f838b25a-fe66-4a23-907c-c1493a86e52f"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "timestamp": "2020-06-09T06:56:34Z",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "category": "Orleans.LifecycleSubject"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT }
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "logLevel": "Error",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "message": "Error calling grain\u0027s OnActivateAsync() method - Grain type = Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain Activation = [Activation: S127.0.0.1:11111:329059910*grn/9CEA1225/6d7a83a6@fee4c0bf #GrainType=Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain Placement=RandomPlacement State=Activating]",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "eventId": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "id": 100513
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "exception": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "type": "System.NullReferenceException",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "message": "Object reference not set to an instance of an object.",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "stackTrace": "   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.CommitInternalAsync(IIndex index, Boolean dispose) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 118\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.AcquireAsync(Guid schemaId) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 73\n   at Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain.OnActivateAsync(Guid key) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/TextIndexerGrain.cs:line 57\n   at Squidex.Infrastructure.Orleans.GrainOfGuid.ActivateAsync(Guid key) in /src/src/Squidex.Infrastructure/Orleans/GrainOfGuid.cs:line 40\n   at Orleans.LifecycleSubject.\u003COnStart\u003Eg__CallOnStart|7_0(Int32 stage, OrderedObserver observer, CancellationToken cancellationToken)\n   at Orleans.LifecycleSubject.OnStart(CancellationToken ct)\n   at Orleans.Runtime.Catalog.CallGrainActivate(ActivationData activation, Dictionary\u00602 requestContextData)"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "app": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "name": "Squidex",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "version": "4.1.0.0",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "sessionId": "f838b25a-fe66-4a23-907c-c1493a86e52f"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "timestamp": "2020-06-09T06:56:34Z",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "category": "Orleans.Runtime.Catalog"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT }
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "logLevel": "Warning",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "message": "Failed to InvokeActivate for [Activation: S127.0.0.1:11111:329059910*grn/9CEA1225/6d7a83a6@fee4c0bf #GrainType=Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain Placement=RandomPlacement State=FailedToActivate].",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "eventId": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "id": 100534
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "exception": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "type": "System.NullReferenceException",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "message": "Object reference not set to an instance of an object.",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "stackTrace": "   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.CommitInternalAsync(IIndex index, Boolean dispose) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 118\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.AcquireAsync(Guid schemaId) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 73\n   at Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain.OnActivateAsync(Guid key) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/TextIndexerGrain.cs:line 57\n   at Squidex.Infrastructure.Orleans.GrainOfGuid.ActivateAsync(Guid key) in /src/src/Squidex.Infrastructure/Orleans/GrainOfGuid.cs:line 40\n   at Orleans.LifecycleSubject.\u003COnStart\u003Eg__CallOnStart|7_0(Int32 stage, OrderedObserver observer, CancellationToken cancellationToken)\n   at Orleans.LifecycleSubject.OnStart(CancellationToken ct)\n   at Orleans.Runtime.Catalog.CallGrainActivate(ActivationData activation, Dictionary\u00602 requestContextData)\n   at Orleans.Runtime.Scheduler.AsyncClosureWorkItem.Execute()\n   at Orleans.Runtime.Catalog.InitActivation(ActivationData activation, String grainType, String genericArguments, Dictionary\u00602 requestContextData)"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "app": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "name": "Squidex",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "version": "4.1.0.0",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "sessionId": "f838b25a-fe66-4a23-907c-c1493a86e52f"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "timestamp": "2020-06-09T06:56:34Z",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "category": "Orleans.Runtime.Catalog"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT }
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "logLevel": "Information",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "action": "HandleEvent",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "actionId": "6827d591-67a2-4828-a227-19d0cd7b5c45",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "status": "Completed",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "eventId": "6827d591-67a2-4828-a227-19d0cd7b5c45",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "eventType": "ContentCreated",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "eventConsumer": "TextIndexer2",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "elapsedMs": 4,
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "app": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "name": "Squidex",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "version": "4.1.0.0",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "sessionId": "f838b25a-fe66-4a23-907c-c1493a86e52f"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "timestamp": "2020-06-09T06:56:34Z"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT }
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "logLevel": "Fatal",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "action": "OnEventAsync",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "status": "Failed",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "eventConsumer": "TextIndexer2",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "exception": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "type": "System.NullReferenceException",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "message": "Object reference not set to an instance of an object.",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "stackTrace": "   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.CommitInternalAsync(IIndex index, Boolean dispose) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 118\n   at Squidex.Domain.Apps.Entities.Contents.Text.IndexManager.AcquireAsync(Guid schemaId) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/IndexManager.cs:line 73\n   at Squidex.Domain.Apps.Entities.Contents.Text.TextIndexerGrain.OnActivateAsync(Guid key) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/TextIndexerGrain.cs:line 57\n   at Squidex.Infrastructure.Orleans.GrainOfGuid.ActivateAsync(Guid key) in /src/src/Squidex.Infrastructure/Orleans/GrainOfGuid.cs:line 40\n   at Orleans.LifecycleSubject.\u003COnStart\u003Eg__CallOnStart|7_0(Int32 stage, OrderedObserver observer, CancellationToken cancellationToken)\n   at Orleans.LifecycleSubject.OnStart(CancellationToken ct)\n   at Orleans.Runtime.Catalog.CallGrainActivate(ActivationData activation, Dictionary\u00602 requestContextData)\n   at Orleans.Runtime.Scheduler.AsyncClosureWorkItem.Execute()\n   at Orleans.Runtime.Catalog.InitActivation(ActivationData activation, String grainType, String genericArguments, Dictionary\u00602 requestContextData)\n   at Orleans.Runtime.Catalog.InitActivation(ActivationData activation, String grainType, String genericArguments, Dictionary\u00602 requestContextData)\n   at Orleans.Internal.OrleansTaskExtentions.\u003CToTypedTask\u003Eg__ConvertAsync|4_0[T](Task\u00601 asyncTask)\n   at Squidex.Domain.Apps.Entities.Contents.Text.GrainTextIndexer.On(Envelope\u00601 event) in /src/src/Squidex.Domain.Apps.Entities/Contents/Text/GrainTextIndexer.cs:line 86\n   at Squidex.Infrastructure.EventSourcing.Grains.EventConsumerGrain.DispatchConsumerAsync(Envelope\u00601 event) in /src/src/Squidex.Infrastructure/EventSourcing/Grains/EventConsumerGrain.cs:line 247\n   at Squidex.Infrastructure.EventSourcing.Grains.EventConsumerGrain.\u003C\u003Ec__DisplayClass12_0.\u003C\u003COnEventAsync\u003Eb__0\u003Ed.MoveNext() in /src/src/Squidex.Infrastructure/EventSourcing/Grains/EventConsumerGrain.cs:line 91\n--- End of stack trace from previous location where exception was thrown ---\n   at Squidex.Infrastructure.EventSourcing.Grains.EventConsumerGrain.DoAndUpdateStateAsync(Func\u00601 action, String caller) in /src/src/Squidex.Infrastructure/EventSourcing/Grains/EventConsumerGrain.cs:line 200"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "app": {
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "name": "Squidex",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "version": "4.1.0.0",
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT     "sessionId": "f838b25a-fe66-4a23-907c-c1493a86e52f"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   },
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT   "timestamp": "2020-06-09T06:56:34Z"
   2020-06-09T07:56:34.29+0100 [APP/PROC/WEB/0] OUT }

Sebastian · June 9, 2020, 7:27am

I hope that I have solved it. Can you send me your backup again?

andrewsgreatstate · June 9, 2020, 7:32am

Just got confirmation that I can send over a backup.
I’m new to the mongo command line, just looking into how to get this to work…

Sebastian · June 9, 2020, 7:54am

Sorry, I have mixed it up with another support request. Can you try current dev version?