For installation instructions check out the getting started guide. Added avro: Added max_decompressed_block_bytes configuration field to cap OCF block decompression and prevent decompression-bomb denial-of-service attacks. (@Jeffail, #4773) aws_kinesis: Added a poll_period field to bound the rate of GetRecords calls per shard, and an enhanced_fan_out configuration block that consumes streams via a…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Fixed aws_dynamodb_cdc: Settle acks by handle and isolate per-shard backpressure (@squiidz, #4739) prometheus: Fixed prometheus exporter accumulating frozen metric series for deleted streams by purging their labels when streams are deleted. (@squiidz, #4742) aws_dynamodb_cdc: Fixed shard discovery aborting on transient failures by…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Fixed aws_dynamodb_cdc: Fixed snapshot_throttle lint rule that was comparing duration string to numeric literal, causing configuration validation to fail. (@squiidz, #4723) aws_dynamodb_cdc: Fixed infinite retry loop when a DynamoDB shard iterator expires after the shard has been deleted by properly classifying the error as permane…
For installation instructions check out the getting started guide. Fixed aws_dynamodb_cdc: Fixed snapshot_throttle lint rule that was comparing duration string to numeric literal, causing configuration validation to fail. (@squiidz, #4723) aws_dynamodb_cdc: Fixed infinite retry loop when a DynamoDB shard iterator expires after the shard has been deleted by properly classifying the error as permane…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Fixed aws_dynamodb_cdc: Fixed snapshot_throttle lint rule that was comparing duration string to numeric literal, causing configuration validation to fail. (@squiidz, #4723) aws_dynamodb_cdc: Fixed infinite retry loop when a DynamoDB shard iterator expires after the shard has been deleted by properly classifying the error as permane…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Added salesforce_cdc: Added decode-failure bounds and classification of schema-fetch errors (deterministic vs transient) to prevent infinite retry loops and livelocks, with terminal failures surfaced clearly to the health check. (@squiidz, #4689) mongodb, mongodb_cdc: Added AWS IAM authentication (MONGODB-AWS) for MongoDB Atlas to…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Added postgres_cdc: Added support for control signals in PostgreSQL CDC by detecting and forwarding rows inserted into a configurable signal table downstream like regular messages. (@josephwoodward, #4637) iceberg: Added an opt-in merge_strategy: copy-on-write for row-level upsert/delete, which materialises mutations by rewriting w…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Fixed kafka: Fixed incorrect validation of max_in_flight_requests with idempotent_write enabled, which was causing silent failures instead of configuration errors. (@prakhargarg105, #4645) oracledb_cdc: Improved Oracle CDC snapshot handling by skipping unnecessary checkpointing during snapshot reads. (@josephwoodward, #4670) redpan…
For installation instructions check out the getting started guide. NOTE: This is a release candidate, you can download a binary from this page. Fixed redpanda: Enabling unordered_processing no longer renames the consumer lag gauge from redpanda_lag to kafka_lag. The redpanda input now emits redpanda_lag in both modes, as documented. (@prakhargarg105, #4663) The full change log can be found here.
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Added oracledb_cdc: Add additional debug log for LogMiner queries. (@josephwoodward, #4653) The full change log can be found here.
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Fixed mssqlserver_cdc: Convert reading of LSN from checkpoint cache to binary to avoid LSN corruption due to read collation decoding. (@josephwoodward, #4644) Changed oracledb_cdc: Improved ability to debug logminer query performance with better debug logging for redo log file loading. (@josephwoodward, #4629) postgres_cdc: Clarifi…
For installation instructions check out the getting started guide. Added aws_dynamodb_partiql: Added use_batch field (default true) to enable single ExecuteStatement calls for PartiQL SELECT queries against Global Secondary Indexes, since BatchExecuteStatement does not support GSI queries. (@squiidz, #4588) migrator: Support ability to set headers via config. (@josephwoodward, #4615) Fixed iceberg…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>