Uploading data with the Data Loader: Supported formats and limits
Learn about supported file formats, size limits, and trimming behavior when uploading data using the Data Loader API.
The Data Loader has different requirements for uploading various file formats.
Supported file formats and sizes
The platform supports CSV, MS Excel, and JSON formats for upload.
| Upload type | CSV | MS Excel | JSON |
|---|---|---|---|
| Local | Max 50 MB | Max 50 MB | No size limit |
| Remote | No size limit unless you enable row consolidation. In that case, the default file size limit is 10 GB. For details, see Create one entity from multiple records. | ||
For general CSV requirement specifications, see RFC 4180 - Common Format and MIME Type for Comma-Separated Values (CSV) Files.
For more information, see Get ready for Data Loader.
Trim special characters
Before data is loaded into Reltio, we ensure that the following special characters are trimmed:
- Leading and trailing spaces: ' '.
- Leading and trailing tabs: \t.
- New line: \n.
- Carriage return: r.
Trimming special characters does not apply to RELTIO_JSON files, since unlike a normal JSON file, the RELTIO_JSON file contains the information needed for the data upload without requiring additional table transformation.
Large dataset optimization
For dataset uploads with more than 10 million rows, the job is automatically allocated more resources and runs with higher concurrency, which is intended to improve data loading throughput.
In most cases, this results in faster data loads. However, performance may vary depending on your tenant's environment and capacity. This is currently available only for tenants hosted in AWS and GCP environments; other cloud providers to follow.