Senseforce
Set up the Senseforce source connector by following this guide.
Sync overview
Prerequisites
- A Senseforce Dataset to export
- Your Senseforce
API Access Token - Your Senseforce
Backend URL - Your Senseforce
Dataset ID
Create a Senseforce Dataset to export
The Senseforce Airbyte connector lets you export custom datasets created by Senseforce users. Follow these steps to configure an exportable dataset:
- Create a new, empty dataset as documented here.
- Add these Senseforce system columns. They’re available for all your custom data models and event schemas:
- Metadata -> Timestamp
- Metadata -> Thing
- Metadata -> Id
- Add any other column from your event schemas that you want to export.
- Enter a descriptive Name and Description, then save the dataset.
- Note the dataset ID. It’s the GUID at the end of the dataset URL path in your browser’s address bar.
Tip: For most exports, place the Timestamp column first. The Airbyte connector automatically sorts it in ascending order. Incremental syncs might not work correctly if the Timestamp column isn’t first.
IMPORTANT: The Timestamp, Thing and Id columns are required for the connector to work as intended. The connector can still work without a column such as “Id”. However, missing any of these three columns might affect functionality. Don’t rename these columns. Keep their default names.
Set up the Senseforce source connector
-
Log in to your Airbyte Cloud or Airbyte Open Source account.
-
Click Sources, then click + New source.
-
On the Set up the source page, select Senseforce from the Source type dropdown.
-
Enter a name for your source.
-
For API Access Token, enter your Senseforce
API Access Token. -
For Senseforce backend URL, enter your Senseforce
Backend URL. -
For Dataset ID, enter your Senseforce
Dataset ID.Create an API access token specifically for Airbyte to control which resources it can access. For reliable operation, create a separate Airbyte User and a separate Senseforce Airbyte Group. Share the dataset with this group. Grant Dataset Read, Event Schema Read and Machine Master Data Read permissions.
-
For The first day (in UTC) when to read data from, enter the day in YYYY-MM-DD format. Data added on or after this day will be replicated.
-
Click Set up source.
Supported sync modes
The Senseforce source connector supports these sync modes:
- Full Refresh
- Incremental
NOTE: The Senseforce Airbyte connector uses the Timestamp column to identify data it has already read. After a sync finishes, newly inserted data with earlier timestamps won’t be included in the next sync. If this behaviour doesn’t suit your use case, follow the next section.
Use Inserted Timestamp for incremental modes
- Rename your “Timestamp” column to “Timestamp_data”.
- Add the Metadata -> Inserted column to your dataset.
- Move the new “Inserted” column to position 1.
- Rename the “Inserted” column to “Timestamp”.
The inserted timestamp will now create the Airbyte cursor. This method produces slower syncs because Senseforce queries generate Datasets more slowly than when using the data timestamp.
Supported streams
The Senseforce source connector supports these streams:
Features
| Feature | Supported?(Yes/No) | Notes |
|---|---|---|
| Full Refresh Sync | Yes | |
| Incremental Sync | Yes |
Performance considerations
Senseforce applies an undocumented rate limit. During normal use, it shouldn’t trigger, even with huge datasets. Create an issue if you experience rate limit issues that automatic retries don’t resolve.
IP allow list
If you use Airbyte Cloud and restrict access to specific IPs, add the Airbyte Cloud IP addresses to your allow list.
Changelog
Expand to review
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 0.2.27 | 2025-05-24 | 60492 | Update dependencies |
| 0.2.26 | 2025-05-10 | 60180 | Update dependencies |
| 0.2.25 | 2025-05-04 | 59594 | Update dependencies |
| 0.2.24 | 2025-04-27 | 59027 | Update dependencies |
| 0.2.23 | 2025-04-19 | 58378 | Update dependencies |
| 0.2.22 | 2025-04-12 | 58005 | Update dependencies |
| 0.2.21 | 2025-04-05 | 57476 | Update dependencies |
| 0.2.20 | 2025-03-29 | 56906 | Update dependencies |
| 0.2.19 | 2025-03-22 | 56323 | Update dependencies |
| 0.2.18 | 2025-03-08 | 55611 | Update dependencies |
| 0.2.17 | 2025-03-01 | 55006 | Update dependencies |
| 0.2.16 | 2025-02-23 | 54562 | Update dependencies |
| 0.2.15 | 2025-02-15 | 54005 | Update dependencies |
| 0.2.14 | 2025-02-08 | 53498 | Update dependencies |
| 0.2.13 | 2025-02-01 | 52957 | Update dependencies |
| 0.2.12 | 2025-01-25 | 52483 | Update dependencies |
| 0.2.11 | 2025-01-18 | 51912 | Update dependencies |
| 0.2.10 | 2025-01-11 | 51356 | Update dependencies |
| 0.2.9 | 2024-12-28 | 50738 | Update dependencies |
| 0.2.8 | 2024-12-21 | 50235 | Update dependencies |
| 0.2.7 | 2024-12-14 | 49662 | Update dependencies |
| 0.2.6 | 2024-12-12 | 49341 | Update dependencies |
| 0.2.5 | 2024-12-11 | 49100 | Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64 |
| 0.2.4 | 2024-11-04 | 48166 | Update dependencies |
| 0.2.3 | 2024-10-29 | 47765 | Update dependencies |
| 0.2.2 | 2024-10-28 | 47567 | Update dependencies |
| 0.2.1 | 2024-08-16 | 44196 | Bump source-declarative-manifest version |
| 0.2.0 | 2024-08-14 | 44073 | Refactor connector to manifest-only format |
| 0.1.15 | 2024-08-12 | 43865 | Update dependencies |
| 0.1.14 | 2024-08-10 | 43704 | Update dependencies |
| 0.1.13 | 2024-08-03 | 43274 | Update dependencies |
| 0.1.12 | 2024-07-27 | 42763 | Update dependencies |
| 0.1.11 | 2024-07-20 | 42247 | Update dependencies |
| 0.1.10 | 2024-07-13 | 41792 | Update dependencies |
| 0.1.9 | 2024-07-10 | 41402 | Update dependencies |
| 0.1.8 | 2024-07-09 | 41242 | Update dependencies |
| 0.1.7 | 2024-07-06 | 40914 | Update dependencies |
| 0.1.6 | 2024-06-25 | 40380 | Update dependencies |
| 0.1.5 | 2024-06-22 | 40190 | Update dependencies |
| 0.1.4 | 2024-06-15 | 39462 | Make compatible with builder |
| 0.1.3 | 2024-06-04 | 39073 | [autopull] Upgrade base image to v1.2.1 |
| 0.1.2 | 2024-05-20 | 38431 | [autopull] base image + poetry + up_to_date |
| 0.1.1 | 2023-02-13 | 22892 | Specified date formatting in specification |
| 0.1.0 | 2022-10-26 | #18775 | 🎉 New Source: Mailjet SMS API [low-code CDK] |