Transcription

An Oracle White PaperFebruary 2014Oracle Data Integrator 12cArchitecture Overview

Oracle Data Integrator 12cArchitecture OverviewIntroductionOracle Data Integrator (ODI) 12c is built on several components all working together around acentralized metadata repository. These components – graphical modules, runtime agents and webbased interfaces – in conjunction with other advanced features make ODI a lightweight, state of the artdata integration platform. This technical brief describes the Oracle Data Integrator 12c architecture indetail.Architecture OverviewThe Oracle Data Integrator architecture is organized around a modular repository, which is accessed inclient-server mode by components such as the ODI Studio and execution Agents that are writtenentirely in Java. The architecture also incorporates web-based components such as the ManagementPack for Oracle Data Integrator which integrates with the Oracle Enterprise Manager CloudControl infrastructure or the ODI Console which enables users to access metadata informationthrough a Web interface.ODI StudioODI Studio provides four graphical Navigators for managing ODI artifacts: Designer, Operator,Topology and Security. ODI Studio offers an easy to use graphical user interface and can be installedon various platforms such as Microsoft Windows or Linux.Figure 1 - ODI Studio Navigators connect to the repository2

Oracle Data Integrator 12cArchitecture OverviewODI Studio Navigators are as follows: Designer defines declarative rules for data transformation and data integrity. All projectdevelopment takes place in this module; this is where database and application metadata areimported and defined. The Designer module uses metadata and rules to generate dataintegration scenarios or load plans for production. This is the core module for developers andmetadata administrators. Operator manages and monitors data integration processes in production. It is designed foroperators and shows execution logs with error counts, the number of rows processed,execution statistics, the actual code that is executed, and so on. At design time, developers canalso use the Operator module for troubleshooting purposes. Topology defines the physical and logical architecture of the infrastructure. Theinfrastructure or projects administrators register servers, database schemas and catalogs, andagents in the master repository through this module. Security manages user profiles, roles and their privileges. Security can also assign accessauthorization to objects and features. Security administrators generally use this module.All modules store their information in the centralized repository.Runtime Components: The AgentsAt runtime, the Agent coordinates the execution of the ODI sessions. It retrieves the code stored inthe ODI repository, connects to the various source and target systems and orchestrates the overall dataintegration process. There are three types of Agents in Oracle Data Integrator 12c: Standalone Agents can be installed on the source or target systems and require a Java VirtualMachine. Colocated Standalone Agents can be installed on the source or target systems as well. Theycan be managed using Oracle Enterprise Manager and must be configured with an OracleWebLogic domain. Colocated Standalone Agents can run on a separate machine from theOracle WebLogic Administration Server. Java Enterprise Edition (Java EE) Agents are deployed on Oracle WebLogic Server andcan benefit from the application server layer features such as clustering for High Availabilityrequirements. Java EE Agents can be managed using Oracle Enterprise Manager.With the Extract-Load Transform (E-LT) architecture, the Agent rarely performs any transformation.It simply retrieves code from the ODI repository and then requests database servers, operatingsystems, or scripting engines to execute that code. When the execution is completed, the Agent updatesthe execution logs in the repository and then reports error messages and execution statistics. Users canreview the execution logs from the Operator Navigator or from Oracle Enterprise Manager.It is important to understand that although the Agent can act as a transformation engine, it is rarelyused for that purpose. Agents are installed at tactical locations in the information system to coordinate3

Oracle Data Integrator 12cArchitecture Overviewthe integration processes and leverage existing systems. They are multithreaded, load-balanced,lightweight components in this distributed integration architecture.Figure 2 - Standalone Runtime ComponentsRepositoriesThe Repository consists of one or more Master Repositories and typically several WorkRepositories. These repositories are sets of tables stored in relational database management systemssuch as Oracle, Microsoft SQL Server, IBM DB2 or MySQL. All objects that the ODI modulesconfigure, develop, or use are stored in one of these repositories, and are accessed in client-servermode by the various components of the architecture.The Master Repository contains the security information (user profiles, roles and privileges), thetopology information (definitions of technologies and servers), and the source code for all versions ofall ODI objects ever versioned. The information contained in the Master Repository is maintained withTopology and Security Navigators in ODI Studio as well as with ODI Console.4

Oracle Data Integrator 12cArchitecture OverviewFigure 3 - Master repository and Work repositoriesProject objects are stored in a Work Repository. Several Work Repositories can coexist in the sameinstallation. This is useful for maintaining separate environments or to reflect a particular versioninglifecycle—for example, development, quality assurance, and production environments.A work repository stores information for Models (i.e. metadata)—including datastores, columns, data integrity constraints, crossreferences, data lineage and impact analysis Projects—including mappings, packages, procedures, folders, knowledge modules, andvariables Runtime information—including scenarios, load plans, scheduling information, andexecution logsUsers manage the content of a work repository with the Designer and Operator Navigators in ODIStudio. The Agent at runtime also accesses work repositories. When a Work Repository is used only tostore execution information (typically for production purposes), it is called an execution repository. Anexecution repository can be accessed at runtime with the Operator Navigator, the Agents and byOracle Enterprise Manager. It is important to remember that each Work Repository is always attachedto one and only one master repository.5

Oracle Data Integrator 12cArchitecture OverviewManagement Pack for Oracle Data IntegratorThe Management Pack for Oracle Data Integrator leverages Oracle Enterprise Manager CloudControl best-in-class application performance management, service level management andconfiguration management capabilities to provide a centralized management solution for Oracle DataIntegrator.The Management Pack for ODI allows administrators to monitor and manage all of their ODIcomponents along with other Oracle products from a single administration console. In addition, itprovides operators and developers end-to-end execution monitoring and drill-down capabilities intoOracle databases activity. End users can also leverage powerful alerting and notification capabilities tomanage their Service Level Agreements (SLA).Figure 4 - Management Pack for Oracle Data IntegratorODI ConsoleODI Console is a Java EE application that can be deployed in a WebLogic domain and providesadministrators with the ability to view and edit Topology objects such as Data Servers, Physical andLogical Schemas as well as to manage their repositories. In addition ODI Console allows users tobrowse Design-Time objects, including projects or models. Through its comprehensive Web interface,users can see flow maps and data lineage diagrams, trace the source of all data, and even drill down tothe field level to understand the transformations used to build the data.6

Oracle Data Integrator 12cArchitecture OverviewOther FeaturesOracle Data Integrator also includes the following components and features: Knowledge Modules make it possible to quickly and easily integrate technologies, databases,and applications. They exist for a large range of platforms, including Oracle, Exadata, BigData, Oracle Applications, Oracle GoldenGate, Teradata, Netezza, SAP ERP, SAP BW andXML. The Changed Data Capture (CDC) framework tracks changes in source systems andreduces the volume of processed data by extracting only the changed data. ODI can use nativedatabase features to capture changes or Oracle GoldenGate. The integration with Oracle Business Intelligence Enterprise Edition provides businessusers with report-to-source data lineage. Advanced Web Services capabilities offer best-in-class integration with Service-OrientedArchitecture (SOA) environments The Load Balancing feature enables large volumes of data to be processed by automaticallybalancing the workload between several Agents. Advanced Version Management provides an interface to manage, safeguard, and replicaterevisions of units of work, even in the largest development environments.ConclusionOracle Data Integrator 12c is a lightweight, state-of-the-art data integration platform. With its superiorperformance and flexible architecture, Oracle Data Integrator can be used in various types of projectssuch as Data Warehousing, SOA, Business Intelligence or Application Integration.7

ODI Architecture OverviewCopyright 2014, Oracle and/or its affiliates. All rights reserved. This document is provided for information purposes only and theFebruary 2014contents hereof are subject to change without notice. This document is not warranted to be error-free, nor subject to any otherAuthor: Julien Testutwarranties or conditions, whether expressed orally or implied in law, including implied warranties and conditions of merchantability orfitness for a particular purpose. We specifically disclaim any liability with respect to this document and no contractual obligations areOracle Corporationformed either directly or indirectly by this document. This document may not be reproduced or transmitted in any form or by anyWorld Headquartersmeans, electronic or mechanical, for any purpose, without our prior written permission.500 Oracle ParkwayRedwood Shores, CA 94065Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respectiveU.S.A.owners.Worldwide Inquiries:AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. IntelPhone: 1.650.506.7000and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and areFax: 1.650.506.7200trademarks or registered trademarks of SPARC International, Inc. UNIX is a registered trademark licensed through X/Openoracle.comCompany, Ltd. 0410

Oracle Data Integrator 12c is a lightweight, state-of-the-art data integration platform. With its superior performance and flexible architecture, Oracle Data Integrator can be used in various types of projectsFile Size: 386KBPage Count: 8Explore furtherOracle Odi 12c Vm Download - blogleaf - Weeblyblogleaf.weebly.comIntroduction to Oracle Data Integratordocs.oracle.comA Oracle Data Integrator Tools Referencedocs.oracle.comODI 12c - Installing ODI Studio - Oracleblogs.oracle.comMinimum RAM requirements for installing ODI . - oracle-techcommunity.oracle.comRecommended to you b