Delta late feature table
The following section outlines some core features like supported storage backends
and operations that can be performed against tables. The state of implementation
of features outlined in the Delta protocol is also tracked.
Cloud Integrations
| Storage |
Rust |
Python |
| Local |
✅ |
✅ |
| S3 - AWS |
✅ |
✅ |
| S3 - MinIO |
✅ |
✅ |
| S3 - R2 |
✅ |
✅ |
| Azure Blob |
✅ |
✅ |
| Azure ADLS Gen2 |
✅ |
✅ |
| Microsoft OneLake |
✅ |
✅ |
| Google Cloud Storage |
✅ |
✅ |
| HDFS |
✅ |
✅ |
| LakeFS |
✅ |
✅ |
Supported Operations
| Operation |
Rust |
Python |
Description |
| Create |
✅ |
✅ |
Create a new table |
| Read |
✅ |
✅ |
Read data from a table |
| Vacuum |
✅ |
✅ |
Remove unused files and log entries |
| Delete - predicates |
✅ |
✅ |
Delete data based on a predicate |
| Optimize - compaction |
✅ |
✅ |
Harmonize the size of data file |
| Optimize - Z-order |
✅ |
✅ |
Place similar data into the same file |
| Merge |
✅ |
✅ |
Merge a target Delta table with source data |
| Update |
✅ |
✅ |
Update values from a table |
| Add Column |
✅ |
✅ |
Add new columns or nested fields |
| Add Feature |
✅ |
✅ |
Enable delta table features |
| Add Constraints |
✅ |
✅ |
Set delta constraints, to verify data on write |
| Drop Constraints |
✅ |
✅ |
Removes delta constraints |
| Set Table Properties |
✅ |
✅ |
Set delta table properties |
| Convert to Delta |
✅ |
✅ |
Convert parquet table to delta table |
| FS check |
✅ |
✅ |
Remove corrupted files from table |
| Restore |
✅ |
✅ |
Restores table to previous version state |
Protocol Support Level
| Writer Version |
Requirement |
Status |
| Version 2 |
Append Only Tables |
✅ |
| Version 2 |
Column Invariants |
✅ |
| Version 3 |
Enforce delta.checkpoint.writeStatsAsJson |
✅ |
| Version 3 |
Enforce delta.checkpoint.writeStatsAsStruct |
✅ |
| Version 3 |
CHECK constraints |
✅ |
| Version 4 |
Change Data Feed |
✅ |
| Version 4 |
Generated Columns |
✅ |
| Version 5 |
Column Mapping |
✅ |
| Version 6 |
Identity Columns |
- |
| Version 7 |
Table Features |
✅ |
| Reader Version |
Requirement |
Status |
| Version 2 |
Column Mapping |
✅ |
| Version 3 |
Table Features (requires reader V7) |
✅ |