You can now enable automatic compaction for Apache Iceberg tables in R2 Data Catalog to improve query performance.
Compaction is the process of taking a group of small files and combining them into fewer larger files. This is an important maintenance operation as it helps ensure that query performance remains consistent by reducing the number of files that needs to be scanned.
To enable automatic compaction in R2 Data Catalog, find it under R2 Data Catalog in your R2 bucket settings in the dashboard.
Or with Wrangler, run:
npx wrangler r2 bucket catalog compaction enable <BUCKET_NAME> --target-size 128 --token <API_TOKEN>To get started with compaction, check out manage catalogs. For best practices and limitations, refer to about compaction.
Source: Cloudflare
Latest Posts
- Durable Objects, Workers – New Asia-Pacific location hints: apac-ne and apac-se
- Durable Objects – Outbound connections keep Durable Objects alive
- (Updated) Upcoming change: Microsoft 365 Apps SAEC and MEC will unify [MC1274325]
- Dynamics 365 Customer Service – Policy strictness control for governance rules [MC1397526]
