Redis
Sync overview
Output schema
Airbyte structures incoming data based on the target Redis cache or data type. The connector maps incoming data from a namespace and stream to a unique Redis key.
For the hash implementation as a Redis data type, keys and hashes use this structure:
key:
namespace:stream:id
hash:
_airbyte_ab_id: Sequential id for a given key, generated using the INCR Redis command._airbyte_emitted_at: A timestamp showing when the event was received from the data source._airbyte_data: A json text/object containing the data received from the data source.
Performance
With enough cache memory, Redis should handle millions of records without issues. It stores data in memory and can periodically save snapshots to disk.
Supported sync modes
| Sync mode | Supported? |
|---|---|
| Full Refresh - Overwrite | Yes |
| Full Refresh - Append | Yes |
| Full Refresh - Overwrite + Deduped | No |
| Incremental Sync - Append | Yes |
| Incremental Sync - Append + Deduped | No |
Getting started
Requirements
- The connector is fully compatible with redis 2.8.x, 3.x.x and above.
- Configuration
- host: Hostname or address of the Redis server you want to connect to.
- port: Port of the Redis server you want to connect to.
- username: Username for authenticating with the Redis server.
- password: Password for authenticating with the Redis server.
- cache_type: Redis cache/data type for storing incoming messages, i.e hash,set,list,stream,etc.
- Turn on SSL to connect using SSL.
- For SSL Modes, select:
- disable to disable encrypted communication between Airbyte and the source.
- verify-full to always require encryption and verify the source’s identity.
Setup guide
This section hasn’t been written.
Namespace support
This destination supports namespaces.