v4.63.0

For installation instructions check out the getting started guide.

Added

• (protobuf) Added Buf Schema Registry support (@josephwoodward)

Fixed

• (Docker) Remove setcap on community Docker image (@mmatczuk)

Changed

• (MSSQL) Migrate from stale denisenkom/go-mssqldb dependency to actively maintained microsoft/go-mssqldb (@josephwoodward)
• (MCP) Apply CORS as in gateway input (@birdayz)
• (MCP) Support rp internal flags (@birdayz)

The full change log can be found here.

v4.62.0

For installation instructions check out the getting started guide.

Added

• Field store_schema_metadata added to the schema_registry_decode processor. (@Jeffail)
• Field schema_metadata added to the parquet_encode processor. (@Jeffail)
• (Benthos) Added TLS support to the input and output socket components. (@eadwright)
• (Benthos) New Bloblang method infer_schema. (@Jeffail)
• Custom s3 endpoints support in snowflake_streaming output. (@josephwoodward)
• Experimental field timely_nacks_maximum_wait added to all kafka protocol inputs. (@Jeffail)
• Added subject_compatibility_level to the schema_registry output. (@mmatczuk)

Fixed

• nats_jetstream output detects disconnects from NATS JetStream server. (@josephwoodward)
• (Benthos) The /debug/stack endpoint no longer truncates large traces. (@Jeffail)

Changed

• All AI processors are now Apache 2.0 licensed. (@Jeffail)

The full change log can be found here.

v4.62.0-rc3

For installation instructions check out the getting started guide.

Added

• Field store_schema_metadata added to the schema_registry_decode processor. (@Jeffail)
• Field schema_metadata added to the parquet_encode processor. (@Jeffail)
• (Benthos) Added TLS support to the input and output socket components. (@eadwright)
• (Benthos) New Bloblang method infer_schema. (@Jeffail)
• Custom s3 endpoints support in snowflake_streaming output. (@josephwoodward)
• Experimental field timely_nacks_maximum_wait added to all kafka protocol inputs. (@Jeffail)
• Added subject_compatibility_level to the schema_registry output. (@mmatczuk)

Fixed

• nats_jetstream output detects disconnects from NATS JetStream server. (@josephwoodward)
• (Benthos) The /debug/stack endpoint no longer truncates large traces. (@Jeffail)

Changed

• All AI processors are now Apache 2.0 licensed. (@Jeffail)

The full change log can be found here.

v4.62.0-rc1

For installation instructions check out the getting started guide.

NOTE: This is a release candidate, you can download a binary from this page.

Added

• Field store_schema_metadata added to the schema_registry_decode processor. (@Jeffail)
• Field schema_metadata added to the parquet_encode processor. (@Jeffail)
• (Benthos) Added TLS support to the input and output socket components. (@eadwright)
• (Benthos) New Bloblang method infer_schema. (@Jeffail)
• Custom s3 endpoints support in snowflake_streaming output. (@josephwoodward)
• Experimental field timely_nacks_maximum_wait added to all kafka protocol inputs. (@Jeffail)

Fixed

• nats_jetstream output detects disconnects from NATS JetStream server. (@josephwoodward)
• (Benthos) The /debug/stack endpoint no longer truncates large traces. (@Jeffail)

The full change log can be found here.

v4.61.0

For installation instructions check out the getting started guide.

Added

• Added host_selection_policy for cassandra input and output. (@jonny7)
• Fields normalize, remove_metadata and remove_rule_set added to schema_registry output. (@mihaitodor)

Fixed

• Fixed an issue with the schema_registry output where schemas with the same ID weren't successfully associated with multiple subjects when translate_ids was set to false. (@mihaitodor)

The full change log can be found here.

v4.60.2

For installation instructions check out the getting started guide.

Added

• Added support for consumer audience for serverless (@chappie)
• Added Taskfile support for the project (@mmatczuk)

The full change log can be found here.

v4.60.1

For installation instructions check out the getting started guide.

Fixed

• Fixed using a credentials_json with gcp_vertex_ai_chat

The full change log can be found here.

v4.60.0

For installation instructions check out the getting started guide.

Added

• The gcp_cloud_storage output field collision_mode now supports interpolation functions. (@Jeffail)

Fixed

• All kafka components now detect unrecoverable connection issues and back off more aggressively. (@Jeffail)
• The redpanda_migrator_offsets input now fetches record timestamps in parallel and discards consumer groups which point to truncated records. (@mihaitodor)

Changed

• The redpanda_migrator input no longer skips tombstone records. (@mihaitodor)

The full change log can be found here.

v4.59.0

For installation instructions check out the getting started guide.

Added

• Field validate_topic added to gcp_pubsub output. (@rockwotj)
• New global CLI flag --chroot-passthrough to specify additional files to be copied into the chroot directory. (@mmatczuk)
• Fields connection_timeout, max_sftp_sessions, host_public_key and host_public_key_file added to the sftp input and output. (@mihaitodor)
• Metadata sftp_mod_time now emitted by the sftp input. (@mihaitodor, @anthonyvitale)
• Field allow_auto_topic_creation added to the redpanda cache. (@mihaitodor)

Fixed

• The sftp input no longer creates new SSH connections for each file it reads. (@mihaitodor, @TColl)
• Fixed a bug with the redpanda_migrator_offsets output where it was attempting to rewind consumer groups if it got restarted after consumers were migrated to the destination cluster. (@mihaitodor)
• Fixed an issue where error logs would not be dispatched to topics when the CLI exited with a non-zero status code. (@Jeffail)
• Fixed mysql_cdc issue with snapshotting AWS RDS. (@mmatczuk)
• The chroot flag makes the internal /tmp directory writable. (@mmatczuk)

The full change log can be found here.

v4.58.2

For installation instructions check out the getting started guide.

Fixed

• Fixed an issue with chroot where not all configuration files were copied, and limited the flag visibility to Linux only. (@mmatczuk)

The full change log can be found here.