Create service integrations
Create service integrations between different Aiven services and move telemetry data using these integrations.
For help with setting up a service integration or to request an integration type or endpoint not yet available, contact the support team
Prerequisites
Ensure you have these services:
- A service that produces the telemetry data. We're using an Aiven for Apache Kafka® service in our example, but this can be any Aiven service.
- An Aiven for PostgreSQL® Database where the telemetry data is stored and can be queried from.
- An Aiven for Grafana® - Dashboards for the telemetry data.
Create an integration
-
In the Aiven Console, create new services including Aiven for Apache Kafka®, Aiven for PostgreSQL®, and Aiven for Grafana®. Choose your preferred cloud provider, region, and a plan from startup, business, or premium.
-
Once all three services are running in the Aiven Console, select the Aiven for PostgreSQL service from the Services page. Ensure you are on the Overview page of your service.
- Select to Integrations from the sidebar.
- Under Aiven services, click Grafana Metrics Dashboard.
- In the Datasource integration window, select the Existing service and choose the Aiven for Grafana service you created.
- Click Enable.
-
To enable metrics from the Aiven for Apache Kafka service, go to the Overview page of your Aiven for PostgreSQL service.
- Select Service integrations from the sidebar.
- Under Aiven services, select Receive Metrics.
- In the Metrics integration window, ensure the Existing service is selected and choose the Aiven for Apache Kafka service.
- Click Enable.
noteThis step allows advanced Aiven for Apache Kafka telemetry data to flow into the Aiven for PostgreSQL service.
-
To view the Aiven for Apache Kafka metrics data in Grafana:
- In the Aiven Console, select your Aiven for Grafana service from the Services page.
- In the Connection information section on the service Overview page, copy the Service URI from the Connection information to access the Grafana service in your browser.
- Log in using the credentials provided in the Connection
information section (the
avnadmin
user and the password).
If you don't see a dashboard after logging in, search for
Aiven Kafka - <YOUR_KAFKA_SERVICE_NAME> - Resources
from the top-left
corner in the Grafana console. This is a predefined dashboard
automatically maintained by Aiven.
Data may take a minute to appear on the dashboard if you've just enabled the integrations. Refresh the view by reloading the page from the top-right corner. You can create custom dashboards either from scratch in Grafana or by saving a copy of the predefined dashboard under a different name that does not start with Aiven.
Any modifications to the predefined dashboard will be automatically overwritten by the system in time.