Skip to main content

We've Moved!

Product Documentation has moved to docs.hitachivantara.com
Hitachi Vantara Knowledge

Services list

This is a description of the HCP for cloud scale services and how to configure them.

HCP for cloud scale services

This table describes the services that HCP for cloud scale runs. Each service runs within its own Docker container. For each service, the table lists:

  • Configuration settings: The settings you can configure for the service.
  • RAM needed per instance: The amount of RAM that, by default, the service needs on each instance on which it's deployed. For all services except for System services, this value is also the default Docker value of Container Memory for the service.
  • Number of instances: Shows both:
    • The minimum number of instances on which a service must run to function properly.
    • The best number of instances on which a service should run. If your system includes more than the minimum number of instances, you should take advantage of the instances by running services on them.
  • Whether the service is persistent (that is, it must run on a specific instance) or supports floating (that is, it can run on any instance).
  • Whether the service is scalable or not.
NoteFor HCP for cloud scale services, you cannot set the size of Container Memory larger than the value of the setting Max Heap Size. For other services, you should not set the size of Container Memory larger than the value of the setting Max Heap Size.
Service name and descriptionConfiguration settings (changes cause the service to redeploy)Properties
Product services: These services perform HCP for cloud scale functions. You can move and reconfigure these services.
Cassandra

Decentralized database that can be scaled across large numbers of hardware nodes.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 2.4 GB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:2.4 GB
Service Options
  • Max heap: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 1200m.
  • Heap new size: Heap size for the Java virtual machine. Valid values are integers representing a number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 512 MB.
Number of instances:

Minimum: 3

Best: All

Service unit cost:10
Advanced Options:

Compaction Frequency: How often the database is compacted. The options are Weekly (default) and Daily.

Caution: Changing this setting can negatively affect the service. Use with caution.

Persistent or floating?Persistent
Supports volume configuration?No
Single or multiple types?Single
Scalable?Yes
Service unit cost:10
Chronos

Job scheduling.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 712 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:712 MB
Service unit cost:1
Service Options
  • Heap settings: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 356 MB.
Number of instances:

Minimum: 1

Best: 1

Persistent or floating?Floating
Supports volume configuration?Yes
Single or multiple types?Single
Scalable?No
Service unit cost:1
Elasticsearch

Data indexing and search platform.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 2 GB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:2 GB
Service unit cost:25
Service Options
  • Heap settings: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 1024 MB.
  • Days to keep logs: The number of days to keep service logs, including access and metrics indexes. The default is 30 days.
  • Index Protection Level: The number of additional replicas (copies) to keep of each index file (shard). Replicas are kept on separate instances. You can set this value for every shard. The default is 1 replica (which means that two copies are kept). The maximum is the number of instances less one.
Number of instances:

Minimum: 3

Best: All

Persistent or floating?Persistent
Supports volume configuration?Yes
Single or multiple types?Single
Scalable?Yes
Service unit cost:25
Kafka

Stream processing platform for handling real-time data streams.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 2 GB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:2 GB
Service unit cost:5
Service Options
  • Heap settings: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 1 GB.
Number of instances:

Minimum: 3

Best: All

Persistent or floating?Persistent
Supports volume configuration?Yes
Single or multiple types?Single
Scalable?Yes
Service unit cost:5
Key Management Server

Manages storage component encryption keys

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 2 GB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.5.
RAM needed per instance:2 GB
Service unit cost:10
Number of instances:

Minimum: 1

Best: 2 or more

Persistent or floating?Floating
Supports volume configuration?Yes
Single or multiple types?Single
Scalable?Yes
Service unit cost:10
Logstash

Collection engine for event data. Can perform transformations on the data it collects and then send that data to a number of outputs.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 700 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:700 MB
Service Options
  • Max heap: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 350 MB.
Number of instances:

Minimum: 1

Best: 1

Persistent or floating?Floating
Supports volume configuration?No
Single or multiple types?Single
Scalable?No
Service unit cost:10
MAPI Gateway

Serves MAPI methods.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 768 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:768 MB
Service unit cost:5
Service Options
  • Max Heap Size: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 384 MB.
Number of instances:

Minimum: 1

Best: All

Persistent or floating?Floating
Supports volume configuration?No
Single or multiple types?Single
Scalable?Yes
Service unit cost:5
Message Queue

Provides system queueing services.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 2048 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.5.
RAM needed per instance:2048 MB
Service unit cost:10
Service Options

None.

Number of instances:

Minimum: 3

Best: 3

Persistent or floating?Floating
Supports volume configuration?No
Single or multiple types?Single
Scalable?No
Service unit cost:10
Metadata Cache

Cache for HCP for cloud scale metadata

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 1024 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:1024MB
Service Options
  • Max Heap Size: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 384 MB.
Number of instances:

Minimum: 1

Best: 1

Persistent or floating?Persistent
Supports volume configuration?No
Single or multiple types?Single
Scalable?No
Service unit cost:10
Metadata Coordination

Coordinates Metadata Gateway service instances and coordinates scaling and balancing.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 768 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:768 MB
Service Options
  • Max Heap Size: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 384 MB.
Number of instances:

Minimum: 1

Best: 1

Persistent or floating?Floating
Supports volume configuration?No
Single or multiple types?Single
Scalable?No
Service unit cost:5
Metadata Gateway

Stores and protects metadata and serves it to other services.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 4096 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:768 MB
Service unit cost:50
Service Options
  • Max Heap Size: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 2048 MB.
Number of instances:

Minimum: 3

Best: All

Persistent or floating?Persistent
Supports volume configuration?No
Single or multiple types?Single
Scalable?Yes
Service unit cost:50
MetricsContainer Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 768 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:768 MB
Service unit cost:10
Service Options
  • Prometheus Scrape Interval: The time interval between runs of the metrics collection task. Type an integer number of seconds. You can optionally specify the suffix s (seconds). The default is 10 seconds.
  • Prometheus Database Path: Storage location for prometheus local time-series db. Type a path. The default is tsdb/.
  • Prometheus Database Retention: The number of days to retain files. Type an integer number of days. You can optionally specify the suffix d (days). The default is 15 days.
Number of instances:

Minimum: 1

Best: 1

Persistent or floating?Persistent
Supports volume configuration?No
Single or multiple types?Single
Scalable?Yes
Service unit cost:10
Policy Engine

Executes system policy operations and asynchronous metadata updates.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 2048 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:768 MB
Service unit cost:25
Service Options
  • Max Heap Size: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 1024 MB.
Number of instances:

Minimum: 1

Best: All

Persistent or floating?Floating
Supports volume configuration?No
Single or multiple types?Single
Scalable?Yes
S3 Gateway

Serves S3 API methods and communicates with storage components.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 768 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:768 MB
Service unit cost:25
Service Options
  • Max Heap Size: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 384 MB.
Number of instances:

Minimum: 1

Best: All

HTTP Options:
  • Enable HTTP: Select to enable HTTP connections.
  • Max Http Request Headers: The maximum number of HTTP request headers to allow. Type an integer. The default is 100 request headers.
Persistent or floating?Floating
Supports volume configuration?No
Single or multiple types?Single
HTTPS Options:
  • SSL Ciphers: A comma-separated list of ciphers used to encode SSL traffic. Changing the list causes the service to redeploy.
Scalable?Yes
Service unit cost:25
Tracing Agent

Supports end-to-end distributed tracing for S3 API calls and MAPI calls.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 768 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:768 MB
Service unit cost:1
Service Options
  • Collector TChannel Hostname: Type a host name. The default is localhost.
  • Collector TChannel Port: Type a port number. The default is 14267.
Number of instances:

Minimum: All

Persistent or floating?Floating
Supports volume configuration?No
Single or multiple types?Single
Scalable?Yes
Service unit cost:1
Tracing Collector

Supports end-to-end distributed tracing for S3 API calls and MAPI calls.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 768 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:768 MB
Service Options
  • ElasticSearch Hostname: Type a host name. The default is localhost.
  • ElasticSearch Port: Type a port number. The default is 9200.
  • Sampling Rate: The sampling rate for all clients implementing remote sampling. Type a number between 0 and 1 inclusive. The default is 1.
  • Max open Index age: How long to keep tracing indexes open in the database, in days. Type a value from 1 to 365 days inclusive. The default is 30 days.
  • Max Index age: How long to keep tracing indexes in the database, in days. Type a value from 1 to 365 days inclusive. The default is 60 days.
Number of instances:

Minimum: 1

Best: All

Persistent or floating?Floating
Supports volume configuration?No
Single or multiple types?Single
Scalable?Yes
Service unit cost:10
Tracing Query

Supports end-to-end distributed tracing for S3 API calls and MAPI calls.

Container Options: Default
  • Container Memory: The hard memory limit for the service's Docker container, in MB. The default is 768 MB.
  • CPU: The relative CPU usage weight for the service's Docker container. Generally, a higher value means that the container receives more CPU resources than other processes (including other service Docker containers) running on the instance. Type a decimal number. The default is 0.1.
RAM needed per instance:768 MB
Service Options
  • ElasticSearch Hostname: Type a host name. The default is localhost.
  • ElasticSearch Port: Type a port number. The default is 9200.
Number of instances:

Minimum: 1

Best: All

Persistent or floating?Floating
Supports volume configuration?No
Single or multiple types?Single
Scalable?Yes
Service unit cost:5
System services: These services manage system resources and ensure that the HCP for cloud scale system remains available and accessible. These services cannot be moved or reconfigured.
Admin App

The system management application.

Service Options
  • Max heap size: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 512 MB.
RAM needed per instance:N/A
Number of instances:N/A
Persistent or floating?Persistent
Supports volume configuration?Yes
Single or multiple types?Single
Scalable?No
Cluster Coordination

Manages hardware resource allocation.

N/ARAM needed per instance:N/A
Number of instances:N/A
Persistent or floating?Persistent
Supports volume configuration?No
Single or multiple types?Single
Scalable?No
Cluster Worker

Receives and performs work from other services.

N/ARAM needed per instance:N/A
Number of instances:N/A
Service unit cost:5
Persistent or floating?Persistent
Supports volume configuration?Yes
Single or multiple types?Single
Scalable?No
Network Proxy

Network request load balancer.

Security Protocol: Select which Transport Layer Security (TLS) versions to use:
  • TLS 1.2
  • TLS 1.3
RAM needed per instance:N/A
SSL Ciphers: To use your own cipher suite, type it here.Number of instances:N/A
Service unit cost:1
Custom Global Configuration: Select Enable Advanced Global Configuration to enable adding your own parameters to the HAProxy "global" section.Persistent or floating?Persistent
Custom Defaults Configuration: Select Enable Defaults Configuration to enable adding your own parameters to the HAProxy "global" section.Supports volume configuration?Yes
Single or multiple types?Single
Scalable?No
Sentinel

Runs internal system processes and monitors the health of the other services.

Service Options
  • Max heap size: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 1024 MB.
RAM needed per instance:N/A
Number of instances:N/A
Persistent or floating?Persistent
Supports volume configuration?Yes
Single or multiple types?Single
Scalable?No
Service Deployment

Handles deployment of high-level services (that is, the services that you can configure).

N/ARAM needed per instance:N/A
Number of instances:N/A
Persistent or floating?Persistent
Supports volume configuration?Yes
Single or multiple types?Single
Scalable?No
Synchronization

Coordinates service configuration settings and other information across instances.

Service Options
  • Max heap size: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 1024 MB.
RAM needed per instance:N/A
Number of instances:N/A
Persistent or floating?Persistent
Supports volume configuration?Yes
Single or multiple types?Single
Scalable?No
Watchdog

Monitors the other System services and restarts them if necessary. Also responsible for initial system startup.

Service Options
  • Max heap size: Maximum amount of memory to allocate to the Java heap for each instance of the service. Type an integer number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 1024 MB.
  • Heap new size: Heap size for the Java virtual machine. Valid values are integers representing a number of bytes. You can optionally specify the suffixes k (kilobytes), m (megabytes), or g (gigabytes). The default is 512 MB.
RAM needed per instance:N/A
Number of instances:N/A
Service unit cost:5
Persistent or floating?Persistent
Supports volume configuration?Yes
Single or multiple types?Single
Scalable?No
Service unit cost:5