AWS Glue

Overview

AWS Glue is a fully managed data catalog and schema registry that simplifies data discovery, preparation, and integration. By leveraging AWS Glue, Zilla can dynamically resolve schemas, ensuring real-time validation of Kafka messages and other structured data formats. Key benefits include:

Dynamic Schema Resolution: Fetch schemas in real-time to validate messages and maintain consistency.
Scalable and Secure: Leverage AWS’s managed services for high availability and security.

catalog:
  type: aws-glue
  options:
    registry: zilla
    max-age: 30
    compression: zlib

Configuration (* required)

options

object

The aws-glue specific options.

Property	Type	Description
options.registry*	`string`	The AWS Glue Registry name to access schemas.
options.max-age	`integer`	Default: `300`
options.compression	`enum` [ `none`, `zlib` ]	Default: `none`