Data Transforms Enhancements

Data Transforms includes the following new features and changes:

• OCI Vault Integration for Connections

  Data Transforms integrates with OCI Vault to allow the use of vault secret credentials to authenticate connections. See Use OCI Vault Secret Credentials for Connections for more information.

• Image Vector Embeddings in Data Flows

  You can add image vector embeddings in a data flow using the Oracle Cloud Infrastructure (OCI) Generative AI service. In the Data Flow Editor, use the Image Embedding Vector operator within the Machine Learning database function to convert input images to vector embeddings. See Use Embedding Vectors in a Data Flow for more information.

• Capture Auditing Information for Data Loads

  The Settings button on the Data Load Detail page now includes options that you can use to add auditing data columns when you run a data load. See Run a Data Load for more details.

• Collect and Publish Statistics for Iceberg tables

  The Workflow editor includes the Iceberg Stats step that lets you collect and publish statistics for Iceberg tables and publish them to external tables. You can use the step independently or add an Iceberg data load to the work flow, and then add Iceberg Stats as a step to collect table and column statistics and publish them to an external table. See Collect and Publish Iceberg Table Statistics to External Tables in Create an Apache Iceberg Connection .

• Enhancements to the Job Details page

  The steps that are displayed on the Job Details page are now categorized in different nodes for ease of reference. These include Admin Jobs, Execution Sets, and Tables. See Create and Manage Jobs for more information about the Job Details page.

• Load Data to Apache Iceberg tables using Snowflake Open Catalog

  You can use Snowflake Data Catalog when you create an Apache Iceberg connection to load data. You can use AWS S3 storage services for storing data into Apache Iceberg as target tables. See Create an Apache Iceberg Connection for detailed instructions.

• Support for Apache Iceberg Parquet File Clustering and Compaction

  Data Transforms supports the Iceberg clustering and compaction features to mitigate increased storage costs and optimize query performance. You can add an Iceberg data load to the work flow, and then add Iceberg Clustering and Compaction as a step. You can then schedule the workflow to run the data load and then execute clustering and compaction on the loaded data. See Parquet File Clustering and Compaction in Create an Apache Iceberg Connection .

• Load Data into Oracle Fusion Incentive Compensation tables

  Oracle Data Transforms enables ingestion of Oracle Fusion Incentive Compensation data from CSV files stored in Oracle Object Storage into Oracle Fusion Incentive Compensation tables. See Create and use an Oracle Fusion Incentive Compensation Connection for more information.

• Load Data into Oracle Fusion Subscription Management tables

  You can use Oracle Data Transforms to stage and load subscription-related data from CSV files stored in Object Storage into the Oracle Fusion Subscription Management application tables. See Create and use an Oracle Fusion Subscription Management Connection for more information.

• Additional Connection Types

  Data Transforms includes support for the MariaDB and Sage Intacct application connection types in this release. For the complete list of supported connection types, see Supported Connection Types .

• Oracle AI Data Catalog Integration for Apache Iceberg

  You can now use Data Transforms to create Apache Iceberg connections by selecting Oracle AI Data Catalog as the catalog provider. See Create an Apache Iceberg Connection for detailed instructions.