
Version 1.16.0 of the CommCare Data Export Tool can export your CommCare data as Delta Lake tables, which Databricks, Microsoft Fabric, and Azure Synapse can read directly, so teams that analyze data in those platforms can keep their CommCare data up to date there on a schedule. Delta Lake export requires installing the Data Export Tool with pip, because the pre-built Windows executable does not include it. Setup steps are in the Export to a Data Lake section of the CommCare Data Export Tool wiki page, and the full list of changes is in the Data Export Tool changelog.
What’s included
- Delta Lake output: The Data Export Tool writes each table in your query file as a Delta Lake table in cloud storage, such as Azure or Amazon S3, or in a local folder.
- Rows updated in place: Each run updates existing rows and adds new ones, matching rows by their id column, so every table in your query file needs an id column.
- Only new and changed data: When you give the Data Export Tool a checkpoint database, which can be a single SQLite file, each run exports only the data that changed since the last successful run. Without a checkpoint database, every run starts the export over from the beginning.
- Faster SQL exports: Exports to SQL databases are now faster and use less memory.
- Python support: The Data Export Tool now supports Python 3.14 and no longer supports Python 3.9.
Read the documentationRelease notes