Limits
Request size
The maximum accepted size of a request to create or update data is limited to 100 MB. If this maximum is exceeded, the request is rejected. If you want to create or update more data, split the data into multiple requests.
Source tables
Total number of source tables
The maximum number of source tables that can be created using the data ingestion API is 100. Each time new tables are created using the API, a check verifies if the maximum number is exceeded. If the number is exceeded, the corresponding request is rejected. All existing tables are counted towards the maximum allowed number, regardless of their origin (API, extraction, manual file upload). This limit does not affect the replacement of the source table.
Number of source tables per request
The maximum number of source tables that can be created with one request is 50. If this number is exceeded, the corresponding request is rejected.
Number of columns
The maximum number of columns that can be created for a source table using the data ingestion API is 500. If this number is exceeded, the corresponding request is rejected. This limit affects both the creation and replacement of the source table.
Total number of tasks
The maximum number of tasks (including ingestion cycles) that can be maintained simultaneously is 350. Each time a new cycle is created using the API, a check verifies if the maximum number is exceeded. If the number is exceeded, the corresponding request is rejected. All existing tasks that are still maintained count towards the accepted maximum, independent of their type (ingestion cycle, extraction, manual file upload, data load, recalculation, process data deletion) or origin (API, automation, manual execution). Maintained tasks are cleaned up automatically at regular intervals of 30 minutes. The cleanup routine deletes all completed tasks, except the 250 most recent entries.
Uploads
Number of data upload targets
The maximum number of source tables (data upload targets) that can be referenced by one upload cycle of the data ingestion API is 100. If this maximum is exceeded, the corresponding request is rejected. If there are more source tables in need of an upload, they must be split into multiple upload cycles.
Number of Pending Data Packages
When uploading data using the data ingestion API, the allowed maximum number of pending upload data packages per table is 50. If this number is exceeded, the corresponding request is rejected. If more data should get uploaded to the target table, set the containing ingestion cycle to completed, which starts the server-side persistence. After the persistence (and the ingestion cycle) is completed, a new cycle can be created to upload the remaining data. Note that the second upload cycle should only be started immediately if the persistence mode of the target table is set to APPEND. If the mode is set to OVERWRITE, you must first load the data (load cycle). Only after loading the data, the remaining data can be uploaded safely.