AWS CloudTrail
Overview
The AWS CloudTrail source supports Full Refresh and Incremental syncs. Choose whether each sync copies only new or updated data. You can instead copy every row in the tables and columns you set up for replication.
This source connector is based on a Boto3 CloudTrail.
Output schema
You can sync the following core streams:
Insight events aren’t currently supported. Only Management events are available.
Data type mapping
| Integration Type | Airbyte Type | Notes |
|---|---|---|
string | string | |
number | integer | |
array | array | |
object | object |
Features
| Feature | Supported?(Yes/No) | Notes |
|---|---|---|
| Full Refresh Sync | Yes | |
| Incremental Sync | Yes | |
| Namespaces | No |
Performance
Lookup requests for the events stream are limited to two per second, per account, per region. The connector retries when it encounters a throttling error. The sync will fail if errors continue after multiple retries. This can happen if you set up many connector instances with the same account and region.
Get started
Requirements
- AWS Access key ID
- AWS Secret access key
- AWS region name
Setup
Follow this steps to get your AWS access key and secret.
IP allow list
If you use Airbyte Cloud and restrict access to specific IPs, add the Airbyte Cloud IP addresses to your allow list.
Changelog
Expand to review
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 1.1.0 | 2024-10-29 | 47287 | Migrate to manifest only format |
| 1.0.20 | 2024-10-29 | 47768 | Update dependencies |
| 1.0.19 | 2024-10-28 | 47096 | Update dependencies |
| 1.0.18 | 2024-10-12 | 46761 | Update dependencies |
| 1.0.17 | 2024-10-05 | 46498 | Update dependencies |
| 1.0.16 | 2024-09-28 | 46156 | Update dependencies |
| 1.0.15 | 2024-09-21 | 45819 | Update dependencies |
| 1.0.14 | 2024-09-14 | 45574 | Update dependencies |
| 1.0.13 | 2024-09-07 | 45304 | Update dependencies |
| 1.0.12 | 2024-08-31 | 45000 | Update dependencies |
| 1.0.11 | 2024-08-24 | 44361 | Update dependencies |
| 1.0.10 | 2024-08-12 | 43756 | Update dependencies |
| 1.0.9 | 2024-08-10 | 43627 | Update dependencies |
| 1.0.8 | 2024-08-03 | 43140 | Update dependencies |
| 1.0.7 | 2024-07-27 | 42642 | Update dependencies |
| 1.0.6 | 2024-07-20 | 42286 | Update dependencies |
| 1.0.5 | 2024-07-13 | 41846 | Update dependencies |
| 1.0.4 | 2024-07-10 | 41435 | Update dependencies |
| 1.0.3 | 2024-07-09 | 41230 | Update dependencies |
| 1.0.2 | 2024-07-06 | 40995 | Update dependencies |
| 1.0.1 | 2024-06-26 | 40419 | Update dependencies |
| 1.0.0 | 2024-07-02 | 36562 | Migrate to low code CDK, Add filtering capability |
| 0.1.12 | 2024-06-22 | 39960 | Update dependencies |
| 0.1.11 | 2024-06-06 | 39246 | [autopull] Upgrade base image to v1.2.2 |
| 0.1.10 | 2024-06-03 | 38911 | Replace AirbyteLogger with logging.Logger |
| 0.1.9 | 2024-06-03 | 38911 | Replace AirbyteLogger with logging.Logger |
| 0.1.8 | 2024-05-20 | 38448 | [autopull] base image + poetry + up_to_date |
| 0.1.7 | 2024-04-15 | 37122 | Base image migration: remove Dockerfile and use the python-connector-base image |
| 0.1.6 | 2024-04-12 | 37122 | schema descriptions |
| 0.1.5 | 2023-02-15 | 23083 | Specified date formatting in specification |
| 0.1.4 | 2022-04-11 | 11763 | Upgrade to Python 3.9 |
| 0.1.3 | 2021-12-23 | 8434 | Update fields in source-connectors specifications |
| 0.1.2 | 2021-08-04 | 5152 | Fix connector spec.json |
| 0.1.1 | 2021-07-06 | 4539 | Add AIRBYTE_ENTRYPOINT for Kubernetes support |
| 0.1.0 | 2021-06-23 | 4122 | Initial release supporting the LookupEvent API |