io.delta.standalone

Class Operation.Metrics

Object

io.delta.standalone.Operation.Metrics

Enclosing class:

Operation

public static class Operation.Metrics
extends Object

Some possible operation metrics and their suggested corresponding operation types. These are purely exemplary, and users may use whichever metrics best fit their application.

Field Summary

Fields

Modifier and Type	Field and Description
static String	executionTimeMs Time taken to execute the entire operation.
static String	numAddedFiles Number of files added.
static String	numConvertedFiles Number of parquet files that have been converted.
static String	numCopiedRows Number of rows copied in the process of deleting files.
static String	numDeletedRows Number of rows removed.
static String	numFiles Number of files written.
static String	numOutputBytes Size in bytes of the written contents.
static String	numOutputRows Number of rows written.
static String	numRemovedFiles Number of files removed.
static String	numSourceRows Number of rows in the source table.
static String	numTargetFilesAdded Number files added to the sink(target).
static String	numTargetFilesRemoved Number of files removed from the sink(target).
static String	numTargetRowsCopied Number of target rows copied.
static String	numTargetRowsDeleted Number of rows deleted in the target table.
static String	numTargetRowsInserted Number of rows inserted into the target table.
static String	numTargetRowsUpdated Number of rows updated in the target table.
static String	numUpdatedRows Number of rows updated.
static String	rewriteTimeMs Time taken to rewrite the matched files.
static String	scanTimeMs Time taken to scan the files for matches.

Constructor Summary

Constructors

Constructor and Description
Metrics()

Method Summary

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

numFiles

public static final String numFiles

Number of files written. Usually used with the WRITE operation.

See Also:

Constant Field Values

numOutputBytes

public static final String numOutputBytes

Size in bytes of the written contents. Usually used with WRITE, STREAMING_UPDATE operations.

See Also:

Constant Field Values

numOutputRows

public static final String numOutputRows

Number of rows written. Usually used with WRITE, STREAMING_UPDATE, MERGE operations.

See Also:

Constant Field Values

numAddedFiles

public static final String numAddedFiles

Number of files added. Usually used with STREAMING_UPDATE, DELETE, UPDATE operations.

See Also:

Constant Field Values

numRemovedFiles

public static final String numRemovedFiles

Number of files removed. Usually used with STREAMING_UPDATE, DELETE, DELETE_PARTITIONS, TRUNCATE, UPDATE operations.

See Also:

Constant Field Values

numDeletedRows

public static final String numDeletedRows

Number of rows removed. Usually used with the DELETE operation.

See Also:

Constant Field Values

numCopiedRows

public static final String numCopiedRows

Number of rows copied in the process of deleting files. Usually used with DELETE, UPDATE operations.

See Also:

Constant Field Values

executionTimeMs

public static final String executionTimeMs

Time taken to execute the entire operation. Usually used with DELETE, DELETE_PARTITIONS, TRUNCATE, MERGE, UPDATE operations.

See Also:

Constant Field Values

scanTimeMs

public static final String scanTimeMs

Time taken to scan the files for matches. Usually used with DELETE, DELETE_PARTITIONS, MERGE, UPDATE operations.

See Also:

Constant Field Values

rewriteTimeMs

public static final String rewriteTimeMs

Time taken to rewrite the matched files. Usually used with DELETE, DELETE_PARTITIONS, MERGE, UPDATE operations.

See Also:

Constant Field Values

numConvertedFiles

public static final String numConvertedFiles

Number of parquet files that have been converted. Usually used with the CONVERT operation.

See Also:

Constant Field Values

numSourceRows

public static final String numSourceRows

Number of rows in the source table. Usually used with the MERGE operation.

See Also:

Constant Field Values

numTargetRowsInserted

public static final String numTargetRowsInserted

Number of rows inserted into the target table. Usually used with the MERGE operation.

See Also:

Constant Field Values

numTargetRowsUpdated

public static final String numTargetRowsUpdated

Number of rows updated in the target table. Usually used with the MERGE operation.

See Also:

Constant Field Values

numTargetRowsDeleted

public static final String numTargetRowsDeleted

Number of rows deleted in the target table. Usually used with the MERGE operation.

See Also:

Constant Field Values

numTargetRowsCopied

public static final String numTargetRowsCopied

Number of target rows copied. Usually used with the MERGE operation.

See Also:

Constant Field Values

numTargetFilesAdded

public static final String numTargetFilesAdded

Number files added to the sink(target). Usually used with the MERGE operation.

See Also:

Constant Field Values

numTargetFilesRemoved

public static final String numTargetFilesRemoved

Number of files removed from the sink(target). Usually used with the MERGE operation.

See Also:

Constant Field Values

numUpdatedRows

public static final String numUpdatedRows

Number of rows updated. Usually used with the UPDATE operation.

See Also:

Constant Field Values

Constructor Detail

Metrics

public Metrics()