Google announced the preview of fine-grained DML

Optimize the Execution of UPDATE, DELETE, and MERGE Statements

Photo by Maxim Tolchinskiy on Unsplash

Google just announced that you can now use fine-grained DML to optimize the execution of UPDATE, DELETE, and MERGE statements on tables. This feature is in Preview[1].

With fine-grained DML (Data Manipulation Language) for BigQuery, Google want customers to be able to enhance the performance of UPDATE, DELETE, and MERGE statements. The benefits of this new feature are[1][2]:

• Granular Approach: Optimizes mutations at a more detailed level than the previous file-group approach
• Reduced Data Rewrites: Aims to minimize the amount of data that needs to be rewritten during operations
• Lower Slot Consumption: Designed to reduce overall slot usage for DML operations

Google just launched Pipe Syntax for BigQuery

To enable fine-grained DML, set the enable_fine_grained_mutations table option to TRUE when you run a CREATE TABLE or ALTER TABLE DDL statement[2]:

CREATE TABLE mydataset.mytable (
  product…