Lucene indexes in Azure

Junim · July 16, 2020, 8:33pm

Hello! I changed the assetStore to AzureBlob because I want the Lucene index there. I defined the type:“AzureBlob”, containerName and connectionString. After deploying the application, the Azure container is not yet in use. Is there any other configuration to be done in Squidex?

github.com

Squidex/squidex/blob/master/backend/src/Squidex/appsettings.json#L279


  /*
   * The number of days request log items will be stored.
   */
  "storeRetentationInDays": 90,
  /*
   * True, to enable datadog integration.
   */
  "datadog": false
},


"assetStore": {
  /*
   * Define the type of the read store. 
   * 
   * Supported: Folder (local folder), MongoDb (GridFS), GoogleCloud (hosted in Google Cloud only), AzureBlob, AmazonS3, FTP (not recommended).
   */
  "type": "Folder",
  "folder": {
    /*
     * The relative or absolute path to the folder to store the assets.
     */

Sebastian · July 17, 2020, 4:59pm

No, this should work, you could upload an image as a test and also reset the text indexer.

Junim · July 17, 2020, 6:27pm

Thx @Sebastian! This test worked for assets. How can I test for Lucene index? I don’t have any Lucene blob in Azure Storage yet.

Sebastian · July 17, 2020, 6:57pm

You have to create or update content item or go to to admin section-> EventConsumers and restart the text indexer

Junim · July 20, 2020, 2:21pm

I did the tests you suggested, but the indices aren’t there yet, although the assets are already there.

Sebastian · July 20, 2020, 2:45pm

Which version do you use? Do you have something in your mongodb db?

Junim · July 20, 2020, 3:27pm

The version is 4.2 and my Mongo is approximately 600 MB

Sebastian · July 20, 2020, 3:42pm

Then they should be part of the asset storage. I think the indexes are just named after the schema id.

It is just a GUID, so they could look very similar to the assets. This is the implementation:

github.com

Squidex/squidex/blob/9f20a3ab7b72a76aec1686781ebeaee7fc75ebc0/backend/src/Squidex.Domain.Apps.Entities/Contents/Text/Lucene/Storage/AssetIndexStorage.cs

// ==========================================================================
//  Squidex Headless CMS
// ==========================================================================
//  Copyright (c) Squidex UG (haftungsbeschraenkt)
//  All rights reserved. Licensed under the MIT license.
// ==========================================================================

using System;
using System.IO;
using System.IO.Compression;
using System.Threading.Tasks;
using Lucene.Net.Index;
using Lucene.Net.Store;
using Squidex.Infrastructure;
using Squidex.Infrastructure.Assets;
using LuceneDirectory = Lucene.Net.Store.Directory;

namespace Squidex.Domain.Apps.Entities.Contents.Text.Lucene.Storage
{
    public sealed class AssetIndexStorage : IIndexStorage

This file has been truncated. show original

Sebastian · July 20, 2020, 3:49pm

Sorry, they are named like the id of the app. The variable name was wrong.

_Junim · July 23, 2020, 1:09pm

Hi @Sebastian, thx for reply and sorry for delay.
These are the blobs in Azure.

Is the second the Index?

Sebastian · July 23, 2020, 2:36pm

No, it is the resized image.