Cassandra
Prerequisites
- If you use Airbyte Open Source with the Postgres source connector, upgrade your Airbyte platform to version
v0.40.0-alphaor newer. Upgrade your Cassandra connector to version0.1.3or newer.
Sync overview
Output schema
Incoming airbyte data is structured into keyspaces and tables. It’s partitioned and replicated across different cluster nodes.
The connector maps each incoming stream to a Cassandra table. It maps each namespace to a Cassandra keyspace.
Fields in the airbyte message become columns in the Cassandra tables. Each table contains the following columns.
_airbyte_ab_id: A random UUID generator used as a partition key._airbyte_emitted_at: A timestamp showing when the event was received from the data source._airbyte_data: JSON text containing the extracted data.
Features
| Feature | Support | Notes |
|---|---|---|
| Full Refresh Sync | ✅ | Warning: this mode deletes all previously synced data in the configured DynamoDB table. |
| Incremental - Append Sync | ✅ | |
| Incremental - Append + Deduped | ❌ |
Performance considerations
Cassandra handles large data volumes by distributing write operations across different cluster nodes. With enough cluster nodes, the database can scale infinitely and handle any amount of connector data.
Get started
Requirements
- The driver is compatible with Cassandra >= 2.1
- Configuration
- Keyspace [default keyspace for writing data]
- Username [authentication username]
- Password [authentication password]
- Address [cluster address]
- Port [default: 9042]
- Datacenter [optional] [default: datacenter1]
- Replication [optional] [default: 1]
Namespace support
This destination supports namespaces. The namespace maps to a Cassandra keyspace and forms part of the table name.
Changelog
Expand to review
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 0.1.4 | 2022-08-23 | 15894 | Replace batch insert with async method |