Data Indexing and Data Discovery

Data indexing and data discovery mechanism can be enabled by integrating germain APM with existing solutions such as SolR or ElasticSearch. More details about these solutions can be found here - Backend - Integrated Apache SolR for Data Indexing and Discovery (<500ms search in a 1 Million dataset)

Prerequisite

Please make sure that your germain APM Datamart schema contains DIMENSION_INDEX table. If it doesn't please create it using datamart-internal.sql DDL script which is available in GermainAPMService distribution file under install/databases/YOUR_DB_VENDOR.

SolR

Installation

Installation steps are available in GermainAPMService distribution file under install/indexer/solr

Integration

Once SoLR installed and running, it must be integrated with germain APM Storage and Query services

Storage Service

In your germain APM Services root folder, go to config and edit storage-services.yml file and make it look similar to this:

# General service properties
storage:
.........
    # Search engine indexer
    indexer:
        vendor: SOLR
		# update URL where SoLR instance is available at
        url: http://localhost:8983/solr/
        # main index name
        indexName: apm
        # Index refresh schedule (every 1h)
        refreshSchedule: 0 0 * * * *            
.........

JAVA

Query Service

In your germain APM Server (Tomcat), go to conf folder and edit query-service.yml fileand make it look similar to this:

# Query service properties
query:
.........
    # Search engine indexer
    indexer:
        vendor: SOLR
		# update URL where SoLR instance is available at
        url: http://localhost:8983/solr/
        # main index name
        indexName: apm
..........

JAVA

Elasticsearch

Installation

Installation steps are available in GermainAPMService distribution file under install/indexer/es

Integration

Once Elasticsearch installed and running, it must be integrated with germain APM Storage and Query services

Storage Service

In your germain APM Services root folder, go to config and edit storage-services.yml file and make it look similar to this:

# General service properties
storage:
.........
    # Search engine indexer
    indexer:
        vendor: ELASTIC_SEARCH
        # update URL where ES instance is available at
        url: http://localhost:9200/
        # main index name
        indexName: apm
        # Index refresh schedule (every 1h)
        refreshSchedule: 0 0 * * * *            
.........

JAVA

Query Service

In your germain APM Server (Tomcat), go to conf folder and edit query-service.yml fileand make it look similar to this:

# Query service properties
query:
.........
    # Search engine indexer
    indexer:
        vendor: ELASTIC_SEARCH
        # update URL where ES instance is available at
        url: http://localhost:9200/
        # main index name
        indexName: apm
..........

JAVA