Aiven for Apache Kafka® metrics available via Prometheus
Explore common metrics available via Prometheus for your Aiven for Apache Kafka® service.
How to retrieve metrics
To get the complete list of available metrics for your service, query the Prometheus endpoint. To get started:
-
Ensure you have the following information:
- Aiven project certificate:
ca.pem
. To download the CA certificate, see Download CA certificates. - Prometheus credentials:
<PROMETHEUS_USER>:<PROMETHEUS_PASSWORD>
- Aiven for Apache Kafka hostname:
<KAFKA_HOSTNAME>
- Prometheus port:
<PROMETHEUS_PORT>
- Aiven project certificate:
-
Use the
curl
command to query the Prometheus endpoint:curl --cacert ca.pem \
--user '<PROMETHEUS_USER>:<PROMETHEUS_PASSWORD>' \
'https://<KAFKA_HOSTNAME>:<PROMETHEUS_PORT>/metrics'
For detailed instructions on setting up Prometheus integration with Aiven, see Use Prometheus with Aiven
CPU utilization
CPU utilization metrics offer insights into CPU usage. These metrics include time spent on different processes, system load, and overall uptime.
Metric | Description |
---|---|
cpu_usage_guest | CPU time spent running a virtual CPU for guest operating systems |
cpu_usage_guest_nice | CPU time spent running low-priority virtual CPUs for guest operating systems. These processes can be interrupted by higher-priority tasks. Metric is measured in hundredths of a second |
cpu_usage_idle | Time the CPU spends doing nothing |
cpu_usage_iowait | Time waiting for I/O to complete |
cpu_usage_irq | Time servicing interrupts |
cpu_usage_nice | Time running user-niced processes |
cpu_usage_softirq | Time servicing softirqs |
cpu_usage_steal | Time spent in other operating systems when running in a virtualized environment |
cpu_usage_system | Time spent running system processes |
cpu_usage_user | Time spent running user processes |
system_load1 | System load average for the last minute |
system_load15 | System load average for the last 15 minutes |
system_load5 | System load average for the last 5 minutes |
system_n_cpus | Number of CPU cores available |
system_n_users | Number of users logged in |
system_uptime | Time for which the system has been up and running |
Disk space utilization
Disk space utilization metrics provide a snapshot of disk usage. These metrics include
information about free and used disk space, as well as inode
usage and
total disk capacity.
Metric | Description |
---|---|
disk_free | Amount of free disk space |
disk_inodes_free | Number of free inodes |
disk_inodes_total | Total number of inodes |
disk_inodes_used | Number of used inodes |
disk_total | Total disk space |
disk_used | Amount of used disk space |
disk_used_percent | Percentage of disk space used |
Disk input and output
Metrics such as diskio_io_time
and diskio_iops_in_progress
provide insights into
disk I/O operations. These metrics cover read/write operations, the duration of these
operations, and the number of bytes read/written.
Metric | Description |
---|---|
diskio_io_time | Total time spent on I/O operations |
diskio_iops_in_progress | Number of I/O operations currently in progress |
diskio_merged_reads | Number of read operations that were merged |
diskio_merged_writes | Number of write operations that were merged |
diskio_read_bytes | Total bytes read from disk |
diskio_read_time | Total time spent on read operations |
diskio_reads | Total number of read operations |
diskio_weighted_io_time | Weighted time spent on I/O operations, considering their duration and intensity |
diskio_write_bytes | Total bytes written to disk |
diskio_write_time | Total time spent on write operations |
diskio_writes | Total number of write operations |
Garbage collector MXBean
Metrics associated with the java_lang_GarbageCollector
provide insights
into the JVM's garbage collection process. These metrics include the collection count
and the duration of collections.
Metric | Description |
---|---|
java_lang_GarbageCollector_G1_Young_Generation_CollectionCount | Returns the total number of collections that have occurred |
java_lang_GarbageCollector_G1_Young_Generation_CollectionTime | Returns the approximate accumulated collection elapsed time in milliseconds |
java_lang_GarbageCollector_G1_Young_Generation_duration | Duration of G1 Young Generation garbage collections |
Memory Usage
Metrics starting with java_lang_Memory
provide insights into the JVM's memory usage,
including committed memory, initial memory, max memory, and used memory.
Metric | Description |
---|---|
java_lang_Memory_committed | Returns the amount of memory in bytes that is committed for the Java virtual machine to use |
java_lang_Memory_init | Returns the amount of memory in bytes that the Java virtual machine initially requests from the operating system for memory management. |
java_lang_Memory_max | Returns the maximum amount of memory in bytes that can be used for memory management |
java_lang_Memory_used | Returns the amount of used memory in bytes. |
java_lang_Memory_ObjectPendingFinalizationCount | Number of objects pending finalization |