From d21cbf4c0b7eb4976d58667100532094afc0dcec Mon Sep 17 00:00:00 2001 From: hcelebi Date: Fri, 5 Jun 2026 13:25:46 +0200 Subject: [PATCH] newblogodimainpage --- .../oracle-data-integrator/README.md | 29 ++- .../LICENSE | 35 ++++ .../README.md | 23 +++ .../KM_LKM_File_to_Oracle__SQLLDR__Plus.xml | 190 ++++++++++++++++++ 4 files changed, 267 insertions(+), 10 deletions(-) create mode 100644 data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/LICENSE create mode 100644 data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/README.md create mode 100644 data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/files/KM_LKM_File_to_Oracle__SQLLDR__Plus.xml diff --git a/data-platform/data-integration/oracle-data-integrator/README.md b/data-platform/data-integration/oracle-data-integrator/README.md index a6eb0e4fa..d42d35b62 100644 --- a/data-platform/data-integration/oracle-data-integrator/README.md +++ b/data-platform/data-integration/oracle-data-integrator/README.md @@ -1,29 +1,38 @@ # Oracle Data Integrator -Oracle Data Integrator is a comprehensive data integration platform that covers all data integration requirements: from high-volume, high-performance batch loads, to event-driven, trickle-feed integration processes, to SOA-enabled data services. Oracle Data Integrator (ODI) 12c, the latest version of Oracle’s strategic Data Integration offering, provides superior developer productivity and improved user experience with a redesigned flow-based declarative user interface and deeper integration with Oracle GoldenGate. ODI12c further builds on its flexible and high-performance architecture with comprehensive big data support and added parallelism when executing data integration processes. It includes interoperability with Oracle Warehouse Builder (OWB) for a quick and simple migration for OWB customers to ODI12c. +Oracle Data Integrator is a comprehensive data integration platform that covers all data integration requirements: from high-volume, high-performance batch loads, to event-driven, trickle-feed integration processes, to SOA-enabled data services. Oracle Data Integrator (ODI) 14c, the latest version of Oracle’s strategic Data Integration offering, provides superior developer productivity and improved user experience with a redesigned flow-based declarative user interface and deeper integration with Oracle GoldenGate. ODI 14c further builds on its flexible and high-performance architecture with comprehensive big data support and added parallelism when executing data integration processes. It includes interoperability with Oracle Warehouse Builder (OWB) for a quick and simple migration for OWB customers to ODI 14c. Reviewed: 03.06.2026 + +# Table of Contents + +1. [Team Publications](#team-publications) +2. [Useful Links](#useful-links) +# Team Publications +- [Automatic Parallelism in SQL*Loader with Oracle Data Integrator and 26ai Database Client](https://github.com/oracle-devrel/technology-engineering/blob/main/data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26) + - How to utilize automatic parallelism in SQL*Loader in ODI with a custom Knowledge Module. + # Useful Links -- [Oracle Data Integrator (ODI) Documentation](https://docs.oracle.com/en/middleware/fusion-middleware/data-integrator/12.2.1.4/odiun/overview-oracle-data-integrator.html#GUID-3B2C52A4-8AFB-424A-9964-29838E875433) +- [Oracle Data Integrator (ODI) Documentation](https://docs.oracle.com/en/middleware/fusion-middleware/data-integrator/14.1.2/index.html) -- [ODI Marketplace Documentation](https://docs.oracle.com/en/middleware/fusion-middleware/data-integrator/12.2.1.4/dimgs/getting-started-oracle-cloud-marketplace.html#GUID-1793F6A6-8581-465D-BBE3-8F0C8ADD6536) +- [ODI Marketplace Documentation](https://docs.oracle.com/en/middleware/fusion-middleware/data-integrator/14.1.2/dimgs/getting-started-oracle-cloud-marketplace.html#GUID-1793F6A6-8581-465D-BBE3-8F0C8ADD6536) - [ODI Certification Matrix](https://www.oracle.com/middleware/technologies/fusion-certification.html) - - System Requirements and Supported Platforms for Oracle Fusion Middleware 14c (14.1.2.0.0) + - System Requirements and Supported Platforms for Oracle Fusion Middleware 14c (14.1.2.0.0) ([xls](https://www.oracle.com/a/tech/docs/middleware/fmw-141200-certmatrix.xlsx)) -- [Install ODI Agent on ExaCC with ODI Marketplace](https://eloi-lopes29.medium.com/install-odi-agent-on-exacc-with-odi-marketplace-c98a1a422f55) +- [Install ODI Agent on ExaCC with ODI Marketplace (Blog)](https://eloi-lopes29.medium.com/install-odi-agent-on-exacc-with-odi-marketplace-c98a1a422f55) -- [Changing the Autonomous Database wallet in ODI Marketplace](https://eloi-lopes29.medium.com/changing-autonomous-database-wallet-in-odi-marketplace-707a2e2dcf9) +- [Changing the Autonomous Database wallet in ODI Marketplace (Blog)](https://eloi-lopes29.medium.com/changing-autonomous-database-wallet-in-odi-marketplace-707a2e2dcf9) -- [ODI — Extracting data from ERP Cloud](https://eloi-lopes29.medium.com/odi-extracting-data-from-erp-cloud-f503baef4499) +- [ODI — Extracting data from ERP Cloud (Blog)](https://eloi-lopes29.medium.com/odi-extracting-data-from-erp-cloud-f503baef4499) -- [ODI — Extracting data from E-Business Suite(EBS)](https://eloi-lopes29.medium.com/odi-extracting-data-from-e-business-suite-ebs-3ec690003a9b) +- [ODI — Extracting data from E-Business Suite(EBS) (Blog)](https://eloi-lopes29.medium.com/odi-extracting-data-from-e-business-suite-ebs-3ec690003a9b) -- [Setting up ODI marketplace High Availability](https://eloi-lopes29.medium.com/setting-up-odi-marketplace-high-availability-b1156d4169ec) +- [Setting up ODI marketplace High Availability (Blog)](https://eloi-lopes29.medium.com/setting-up-odi-marketplace-high-availability-b1156d4169ec) -- [ODI’s Guide to Configuring HTTPS with Collocated Agents](https://eloi-lopes29.medium.com/odis-guide-to-configuring-https-with-collocated-agents-219cb634e9ce) +- [ODI’s Guide to Configuring HTTPS with Collocated Agents (Blog)](https://eloi-lopes29.medium.com/odis-guide-to-configuring-https-with-collocated-agents-219cb634e9ce) # License diff --git a/data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/LICENSE b/data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/LICENSE new file mode 100644 index 000000000..4e179622a --- /dev/null +++ b/data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/LICENSE @@ -0,0 +1,35 @@ +Copyright (c) 2026 Oracle and/or its affiliates. + +The Universal Permissive License (UPL), Version 1.0 + +Subject to the condition set forth below, permission is hereby granted to any +person obtaining a copy of this software, associated documentation and/or data +(collectively the "Software"), free of charge and under any and all copyright +rights in the Software, and any and all patent rights owned or freely +licensable by each licensor hereunder covering either (i) the unmodified +Software as contributed to or provided by such licensor, or (ii) the Larger +Works (as defined below), to deal in both + +(a) the Software, and +(b) any piece of software and/or hardware listed in the lrgrwrks.txt file if +one is included with the Software (each a "Larger Work" to which the Software +is contributed by such licensors), + +without restriction, including without limitation the rights to copy, create +derivative works of, display, perform, and distribute the Software and make, +use, sell, offer for sale, import, export, have made, and have sold the +Software and the Larger Work(s), and to sublicense the foregoing rights on +either these or other terms. + +This license is subject to the following condition: +The above copyright notice and either this complete permission notice or at +a minimum a reference to the UPL must be included in all copies or +substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE +AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER +LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, +OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE +SOFTWARE. \ No newline at end of file diff --git a/data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/README.md b/data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/README.md new file mode 100644 index 000000000..128bc8692 --- /dev/null +++ b/data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/README.md @@ -0,0 +1,23 @@ +# Automatic Parallelism in SQL*Loader with Oracle Data Integrator and 26ai Database Client + +Reviewed: 05.06.2026 + +Why move Teradata to Autonomous Data Warehouse on OCI? + + +SQL Loader is one of the most efficient ways to load large text files into Oracle Database. Starting with 26ai Oracle AI Database client releases it is possible to automate parallelism in SQL Loader jobs. Instead of manually splitting one large input file into multiple smaller files and running several SQL Loader jobs, SQL Loader can parallelize the load internally from one data file, one control file, and one command. + +In Oracle Data Integrator, we can take advantage of this new capability by using a Knowledge Module and creating a basic mapping pointing to our source file and target table. ODI provides out of the box Knowledge Modules and LKM File to Oracle (SQLLDR) is commonly used when loading delimited or fixed-width files into Oracle tables, especially for high-volume loads where row-by-row JDBC loading is not ideal. + +## How to use this asset? +This blog post explains steps to utilize automatic parallelism via a new custom Knowledge Module which can be downloaded from files subfolder. +[Link to full blog post in Medium](https://medium.com/@hncelebi/automatic-parallelism-in-sql-loader-with-oracle-data-integrator-and-26ai-database-client-ba4a9332a7b2) + + +# License + +Copyright (c) 2026 Oracle and/or its affiliates. + +Licensed under the Universal Permissive License (UPL), Version 1.0. + +See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details. diff --git a/data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/files/KM_LKM_File_to_Oracle__SQLLDR__Plus.xml b/data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/files/KM_LKM_File_to_Oracle__SQLLDR__Plus.xml new file mode 100644 index 000000000..f31509fe3 --- /dev/null +++ b/data-platform/data-integration/shared-assets/parallel-sqlloader-odi-aidatabase26/files/KM_LKM_File_to_Oracle__SQLLDR__Plus.xml @@ -0,0 +1,190 @@ + + + + + + null + null + null + null + null + null + + + + + null + null + null + null + null + null + + + + null + null + + null + null + + + + + + + + + + + + null + null + + + + + + null + + null + null + + null + null + null + null + null + null + null + + + null + + + + null + null + null + + + + + 1996;96 + "MMMM(M)*" "MONTH" // Month, supported: MMMM => July + "MMM" "MON" // Month, supported: MMM => JUL + "M" "M" // Month, supported: MM;M => 07;7 + "W" "W" // Week in month + "w" "WW" // Week in year + "DDD" "DDD" // Day in year + "dd" "DD" // Day in month + "a" "AM" // Am/pm marker + "HH" "HH24" // Hour in day (0-23) + "KK" "HH12" // Hour in day (0-11) + "mm" "MI" // Minute in hour + "SSSSSS" "FF6" // Millisecond in second + "SSSSS" "FF5" // Millisecond in second + "SSSS" "FF4" // Millisecond in second + "SSS" "FF3" // Millisecond in second + "SS" "FF2" // Millisecond in second + "S" "FF1" // Millisecond in second + "ss" "SS" // Second in minute + "Z" "TZH:TZM" // Timezone, supported: Z => +02:00 + +BASIC CONFIGURATION + 1. Specify the logical format for NUMERIC and DATE columns, + if the format does not match client nls settings. + 2. Set NLS_DATE_LANGUAGE, if your dates contain language specific elements + such as month names and the client language does not match these. + Note: select * from nls_session_parameters returns nls settings of client. + 3. Set NLS_NUMERIC_CHARACTERS, if your file number format does not match the client NLS + settings. + +OPTIONS (Refer to Option descriptions for more information on each option) + - DELETE_TEMPORARY_OBJECTS: Delete temp objects after integration phase + - WORK_TABLE_OPTIONS: table options for work table + - LOA_DIRECT: Use direct path insert? + - LOA_PARALLEL: Use Automatic Parallel load? + - DEGREE_OF_PARALLELISM: Number of threads used for parallel loading + - LOA_DISCARDMAX: Max number of records to discard + - LOA_ERRORS: Max number of errors for SQL Loader + - COMPATIBLE: Installed Oracle Database Client major version + - VALIDATE: Validate use of KM and options + - NLS_DATE_LANGUAGE: Language of date/timestamp elements + - NLS_NUMERIC_CHARACTERS: Override client NLS_NUMERIC_CHARACTERS setting + - CHARSET_ENCODING: Character set of the input file + +LIMITATIONS + Only file technology data types NUMERIC, DATE (including TIMESTAMP) and CHAR are + supported. + For Timestamps with timezones TZ will be truncated. For loading TS with TZ, please specify + the source column as STRING and apply the appropriate String to TS with TZ transformation, + e.g. + TO_TIMESTAMP_TZ(ALIAS.COL, 'YYYY-MM-DD HH24:MI:SS TZH:TZM') + It may occur that SQL*LOADER returns a 0 code (OK) even if the data was not loaded. + Consult the log files for more information.]]> + + + + + + + + + + + + null + null + null + + + + + + + + + + + + + + + + + + + + + + + + +