Exasol
Exasol is an in-memory database built for analytics.
Sync overview
Output schema
Each Airbyte Stream becomes an Exasol table. Each Airbyte Field becomes an Exasol column. Every Exasol table created by Airbyte contains three columns:
_AIRBYTE_AB_ID: a uuid that Airbyte assigns to each processed event. The Exasol column type isVARCHAR(64)._AIRBYTE_DATA: a json blob containing the event data. The Exasol column type isVARCHAR(2000000)._AIRBYTE_EMITTED_AT: a timestamp showing when the event was pulled from the data source. The Exasol column type isTIMESTAMP.
Features
The Exasol destination supports these features:
| Feature | Supported? (Yes/No) | Notes |
|---|---|---|
| Full Refresh Sync | Yes | |
| Incremental - Append Sync | Yes | |
| Incremental - Append + Deduped | No | |
| Normalization | No | |
| Namespaces | Yes | |
| SSL connection | Yes | TLS |
| SSH Tunnel Support | No |
Limitations
Maximum data size: two million characters
Exasol doesn’t have a dedicated data type for arbitrary-length data or JSON. This connector therefore stores Airbyte data using type VARCHAR(2000000).
Getting started
Requirements
You’ll need Exasol database version 7.1 or above to use the Exasol destination.
Network access
Make sure Airbyte can access your Exasol database. For databases within a VPC, you may need to allow the IP used to expose Airbyte.
Permissions
Airbyte namespaces let you store data in different schemas. Each scenario requires different permissions for the user account. The following table describes four scenarios for the login user and destination user.
| Login user | Destination user | Required permissions | Comment |
|---|---|---|---|
| DBA User | Any user | - | |
| Regular user | Same user as login | Create, drop and write table, create session | |
| Regular user | Any existing user | Create, drop and write ANY table, create session | Grants can be provided on a system level by DBA or by target user directly |
| Regular user | Not existing user | Create, drop and write ANY table, create user, create session | Grants should be provided on a system level by DBA |
You should create an Airbyte-specific user for this purpose.
Setup guide
You now have everything needed to configure Exasol as a destination in the UI. You’ll need these details:
- Host
- Port
- Fingerprint of the Exasol server’s TLS certificate (if the database uses a self-signed certificate)
- Username
- Password