Aiven now integrates with AWS CloudWatch and Google Cloud Logging

It is now possible to send the logs of your Aiven services to Amazon AWS CloudWatch and Google Cloud Logging for storing, viewing, and archiving outside the Aiven platform.

13 July 2020
Michael HalykContent Marketing Manager at Aiven

For those of you running your logs and metrics infrastructure in AWS CloudWatch or Google Cloud Logging, life just got a little easier — you can now include your Aiven service logs with a simple integration.

Once enabled, you’ll not only have a more consolidated overview of your logs but be able to manage your Aiven logs more efficiently, whether searching them or performing other actions such as setting alerts.

How simple is it to set up this integration? A few minutes is all it takes. Let’s dive into the details.

How to enable service log integrations in the Aiven Console

In this post, we’ll cover the integration setup process in Aiven’s Web Console. For instructions on setting up the integrations using the Aiven Client, check out our AWS CloudWatch and Google Cloud Logging help articles.

AWS CloudWatch

First, you need to add an AWS CloudWatch Logs integration endpoint to your Aiven project. You can do this by navigating to the Service Integrations section of your project. You will need to input your access rights credentials to create the endpoint.

aws cloudwatch logs access rights fixed

Once the endpoint is created, you can enable the integration by navigating to your service and selecting Manage Integrations. Select AWS CloudWatch Logs from the list of integrations.

Select cloudwatch integration

Choose the endpoint you created earlier.

choose aws cloudwatch integration endpoint

Attaching the service to an endpoint will enable service logs to be sent into AWS CloudWatch. Aiven will automatically create log streams for you in AWS CloudWatch to the log group you created in the integration endpoint configuration.

Google Cloud Logging

As with AWS CloudWatch, the first step is to add a Google Cloud Logging integration endpoint to your Aiven project by navigating to Service Integrations. Configure the GCP Project ID and the Log ID used for the logs you send to Google Cloud Logging.

google cloud logging access rights fixed

Once the endpoint is created, you can enable the integration by navigating to the service you want to send logs from and clicking Manage Integrations. Select Google Cloud Logging from the list of integrations.

select cloud logging from list of integrations

Choose the endpoint you created earlier.

choose cloud logging endpoint

And that’s it! Your Aiven service logs will be sent to Google Cloud Logging once you attach your service to the endpoint and you’ll be able to view the logs in your Google Cloud Platform console!

Wrapping up

These two integrations allow you to more seamlessly incorporate your Aiven services into your AWS and GCP deployments. For detailed instructions on how to set up the logs integrations, read our help center articles for setting up AWS CloudWatch and Google Cloud Logging.

We’ll also be extending the integration to allow you to send Aiven service resource metrics to them in the near future. In the meantime, subscribe to our changelog and blog RSS feeds, and follow us on LinkedIn and Twitter to stay up-to-date with product updates, and new services.

announcementsintegrations

Start your free 30 day trial

Test the whole platform for 30 days with no ifs, ands, or buts.

Aiven logo

Let‘s connect

Apache Kafka, Apache Kafka Connect, Apache Kafka MirrorMaker 2, Apache Cassandra, Elasticsearch, PostgreSQL, MySQL, Redis, InfluxDB, Grafana are trademarks and property of their respective owners. All product and service names used in this website are for identification purposes only and do not imply endorsement.