You can now enable automatic compaction for Apache Iceberg tables in R2 Data Catalog to improve query performance.
Compaction is the process of taking a group of small files and combining them into fewer larger files. This is an important maintenance operation as it helps ensure that query performance remains consistent by reducing the number of files that needs to be scanned.
To enable automatic compaction in R2 Data Catalog, find it under R2 Data Catalog in your R2 bucket settings in the dashboard.
Or with Wrangler, run:
npx wrangler r2 bucket catalog compaction enable <BUCKET_NAME> --target-size 128 --token <API_TOKEN>To get started with compaction, check out manage catalogs. For best practices and limitations, refer to about compaction.
Source: Cloudflare
Latest Posts
- Amazon Quick Adds Custom Sort for Filter Controls
- Amazon GameLift Streams now supports Proton 10 runtime
- Gateway – Gateway Authorization Proxy and hosted PAC files are now generally available
- Digital Experience Monitoring – Digital experience tests to authenticated resources and enhanced configuration
