Product updates

Get the latest updates on features, fixes and improvements.

709 results

  • Sep 6, 2024

    Set replication factor to 0 in Aiven for OpenSearch®

    You can now set the replication factor (`number_of_replicas`) to 0, which means that no replica shards are created. This reduces storage usage but increases the risk of data loss if a node fails. It's ideal for non-critical environments like QA or testing. You can set this when creating or updating an index in the OpenSearch Dashboard.

    Note: Enabling this setting comes with a reduced SLA, which must be agreed upon with your account manager.

    For more details, see the Replication factors in Aiven for OpenSearch.

  • Sep 6, 2024

    Aiven for Apache Kafka® upgraded to 3.8

    Aiven for Apache Kafka® has been upgraded to version 3.8. This update includes various improvements and bug fixes, enhancing the overall performance, security, and reliability of your Apache Kafka clusters.
    For more information, see Apache Kafka® 3.8 release notes.

  • Sep 3, 2024

    TimescaleDB extension 2.16.1 for Aiven for PostgreSQL® released

    TimescaleDB extension version 2.16.1 is now available for Aiven for PostgreSQL®. It introduces new features, performance improvements, and bug fixes on top of release 2.15.3. Upgrade to 2.16.1 at your earliest convenience to make sure you use the most robust and secure version available.

    Refer to TimescaleDB release notes for 2.16.0 and TimescaleDB release notes for 2.16.1 for all the changes introduced in these release.

    Key new features

    • Performance-focused optimizations for data manipulation operations (DML) over compressed chunks: Improved UPSERT performance by more than 100x in some cases and more than 1000x in some update/delete scenarios.
    • Ability to define chunk skipping indexes on non-partitioning columns of compressed hypertables: Extended chunk exclusion to use those skipping (sparse) indexes when queries filter on the relevant columns and prune chunks that don't include any relevant data for calculating the query response.
    • For use cases that require foreign keys defined:
      • Ability to add foreign keys from regular tables towards hypertables
      • Removed some locks in the reverse direction that blocked access to referenced tables while compression was running.
    • Extended Continuous Aggregates to support more types of analytical queries:
      • More types of JOINs supported
      • Additional equality operators on JOIN clauses supported
      • JOINs between multiple regular tables supported

    More new features

    • #6880: Added support for the array operators used for compressed DML batch filtering.
    • #6895: Improved the compressed DML expression pushdown.
    • #6897: Added support for replica identity on compressed hypertables.
    • #6918: Removed support for PG13.
    • #6920: Reworked compression activity WAL markers.
    • #6989: Added support for foreign keys when converting plain tables to hypertables.
    • #7020: Added support for the chunk column statistics tracking.
    • #7048: Added an index scan for INSERT DML decompression.
    • #7075: Reduced decompression on the compressed INSERT.
    • #7101: Reduced decompressions for the compressed UPDATE/DELETE.
    • #7108 Reduced decompressions for INSERTs with UNIQUE constraints.
    • #7116 Used DELETE instead of TRUNCATE after compression.
    • #7134 Refactored foreign key handling for compressed hypertables.
    • #7161 Fixed mergejoin input data is out of order.

    Improvements

    • Improved query performance through chunk exclusion on compressed hypertables: You can now define chunk skipping indexes on compressed chunks for any column with one of the following integer data types: smallint, int, bigint, serial, bigserial, date, timestamp, timestamptz. After you call enable_chunk_skipping on a column, TimescaleDB tracks the min and max values for that column. TimescaleDB uses that information to exclude chunks for queries that filter on that column, and would not find any data in those chunks.
    • Improved UPSERT performance on compressed hypertables: By using index scans to verify constraints during inserts on compressed chunks, TimescaleDB speeds up some ON CONFLICT clauses by more than 100x.
    • Improved performance of UPDATEs, DELETEs, and INSERTs on compressed hypertables: By filtering data while accessing the compressed data and before decompressing, TimescaleDB has improved performance for UPDATEs and DELETEs on all types of compressed chunks, as well as INSERTs into compressed chunks with unique constraints. By signaling constraint violations without decompressing or decompressing only when matching records are found in the case of UPDATEs, DELETEs, and UPSERTs, TimescaleDB 2.16.0 speeds up those operations more than 1000x in some UPDATE/DELETE scenarios, and 10x for UPSERTs.
    • Ability to add foreign keys from regular tables to hypertables with support for all types of cascading options; useful for hypertables that partition using sequential IDs and need to reference those IDs from other tables.
    • Lower locking requirements during compression for hypertables with foreign keys: Advanced foreign key handling removes the need for locking referenced tables when new chunks are compressed. DML is no longer blocked on referenced tables while compression runs on a hypertable.
    • Improved support for queries on Continuous Aggregates
      • INNER/LEFT and LATERAL JOINs are now supported.
      • Ability to join with multiple regular tables
      • Ability to have more than one equality operator on JOIN clauses

    Bug fixes

    • #7182 Fixed untier_chunk for hypertables with foreign keys.
    • #6987 Fixed REASSIGN OWNED BY for background jobs.
    • #7018: Fixed search_path quoting in the compression defaults function.
    • #7046: Prevented locking for compressed tuples.
    • #7055: Fixed the scankey for segment by columns, where the type constant is different to variable.
    • #7064: Fixed the bug in the default order by calculation in compression.
    • #7069: Fixed the index column name usage.
    • #7074: Fixed the bug in the default segment by calculation in compression.
  • Sep 2, 2024

    New

    Aiven for Apache Kafka® Connect

    Aiven for Apache Kafka® Connect secret providers

    Aiven for Apache Kafka Connect now supports authentication using secrets from external providers. This allows you to securely reference these secrets within your connector configurations, providing a wider variety of options for securing Apache Kafka Connect traffic. Supported secret managers include:

    • AWS Secrets Manager
    • HashiCorp Vault

    For more information, see Aiven for Apache Kafka® Connect secret providers.

  • Aug 21, 2024

    Improved

    Aiven for ClickHouse®

    External sources supported for dictionaries in Aiven for ClickHouse®

    By using managed credentials integration, now you can create dictionaries in Aiven for ClickHouse® with remote PostgreSQL®, remote MySQL®, or remote ClickHouse as sources. The sources supported so far (HTTP(s), remote ClickHouse, and Aiven for ClickHouse) don’t need the managed credentials integration.

    To learn more about using dictionaries in Aiven for ClickHouse, see the documentation.

  • Aug 21, 2024

    New

    Aiven for ClickHouse®

    Managed credentials integration with Aiven for ClickHouse®

    Aiven for ClickHouse® now supports managed credentials integration, which allows you to to efficiently connect with external data sources by storing connection credentials in Aiven. Querying data is easier and quicker: you no longer need connection credentials in each query because they are accessed from Aiven storage.

    Managed credentials integration in Aiven for ClickHouse is supported with the following data source types: PostgreSQL®, MySQL®, ClickHouse®, and Amazon S3®.

    Learn how to enable and use Aiven for ClickHouse managed credentials integration in our documentation.

  • Aug 19, 2024

    Improved

    Aiven for Apache Kafka® MirrorMaker 2

    Aiven for Apache Kafka® MirrorMaker 2 version 3.7.1

    Aiven for Apache Kafka® MirrorMaker 2 has been updated to version 3.7.1. This release includes important bug fixes and performance improvements that enhance data replication between Kafka clusters.

    Improvements

    • Improved the handling of MirrorCheckpointTask restarts to prevent permanent interruptions in offset translation (KAFKA-15905).

    Bug fixes

    • Fixed an issue where the auto.offset.reset=latest configuration did not function as expected, ensuring topics are read from the latest offset (KAFKA-13988).
    • Addressed a potential null pointer exception (NPE) in MirrorCheckpointTask (KAFKA-15607).
    • Resolved a problem where the first checkpoint was not emitted until the consumer group had fully caught up (KAFKA-16622).

    For further details and updates, see the Apache Kafka release notes.

  • Aug 15, 2024

    Improve search results with OpenSearch rollup indexes

    A new setting, plugins.rollup.search.search_all_jobs, is now available in OpenSearch to address issues with incomplete search results when querying rollup indexes that contain data from multiple jobs. Enable this setting in Advanced Configurations for a complete search of all rollup data.

    Note: Changing this setting is not recommended, as the default configuration is suitable for most use cases.

    For more information, see Index rollup settings.

  • Aug 15, 2024

    Aiven for PostgreSQL® upgraded to 16.4, 15.8, 14.13, 13.16, and 12.20

    Aiven for PostgreSQL® has been upgraded to latest minor versions 16.4, 15.8, 14.13, 13.16, and 12.20. This upgrade introduces fixes to previous versions, addressing issues with handling partitioned tables among other things. Removing bugs and security vulnerabilities increases database performance, improves service availability, and helps ensure business continuity.

    See PostgreSQL release notes for more details about the PostgreSQL® minor releases.