The Oracle Data Integrator 11g Blog

Tuesday, 27 December 2011

Oracle Data Integrator Components

Oracle Data Integrator Components
Oracle Data Integrator (ODI) is a software application based on ETL (extract-transform-load) structure used for data transformation and merging processes. In today's business the meaning of well organized data has increased dramatically and that is why having specialized software is so important.

Furthermore, these applications must be prepared to work in mixed systems and platforms environment and be sure that none of the quality will deteriorate. Oracle Data Integrator provides decalrative rules apart from implementation details and also its E-LT (extract-load, transform) structure eliminates need of having separate ETL server which results in optimized performance, efficiency and scalability.

Main architecture component in Oracle Data Integrator is the repository that is accessed by client-server mode or thin client mode. Repository is absolutely open, comprehensive, shared metadata database which is accessible for the applications responsible for transformation, project development, integration and information redistribution. Other architecture components are the Topology Manager, Designer, Security Manager, Operator, Agent, Scheduler and Metadata Navigator. Graphical interface module that manages all the information about system's physical and logical structure is called the Topology Manager. Descriptions created with the Topology Manager of server data, machine and site will allow to run same interfaces on different systems. A tool designed to develop transformations and to check data integrity is called Designer. Among many fuctions its most significant are visualization of data flow, development and maintenance data integration and transformation, reverse-engineering of applications or repository's data. Oracle Data Integrator permissions and users management tool is simply called Security Manager. Operator is the module responsible for monitoring and production management.


Agent executes application interfaces which Designer designed, next the Scheduler schedules them. Metadata Navigator browses through contents of Oracle Data Integrator Repository in search of wanted content. It is a thin client-oriented for search and analysis but also to manage all production processes, it can also trace and cross-reference data lineage. Apart from this standard modules comes a bunch of „out-of-the-box” modules which can be fully extensible, e.g. Log Miner, SQL Server Triggers, Oracle DBLink, Check MS Excel, Oracle Merge, Check Sybase – all as a part of Pluggable Knowledge Architecture are written for certain systems and environments and in fact are the very core of the Oracle Data Integrator, making the whole process accessible, modular and as simple as it can be. In case where our target is an Oracle database, natural choice is to go with Oracle Warehouse Builder, but where target is not an Oracle based environment, like SQL Server or XML, Teradata we can use Oracle Data Integrator to support OWB. When the source is XML or Web Service, SOAP then ODI supplements as well.

Clearly Oracle Data Integrator can be used in many different cases – e.g. when some dirty data has to be filtered out before loading, or data integration is very complicated or/and processed in real-time.

Oracle Data Integrator works as well in the staging and transforming area as the support for other Oracle software. It is „hot pluggable” which means connecting to any heterogeneous environment and still provide with number of required operations.

Thanks & Regards
 WWW.ODIGURUS.COM

Tuesday, 22 November 2011

Router Transformation

Hi Gurus,

 The Following videos explain how to do Router Transformation using ODI.


 Hope you will learn several ODI features by watching these videos











 Thanks & Regards
 WWW.ODIGURUS.COM

Thursday, 3 November 2011

ODI JOIN

Hi Gurus,
Today i am sharing the video which explains how to do join between two tables using ODI.

In this video i used to perform join between EMP and DEPT table using the following condition

EMP.DEPTNO=DEPT.DEPTNO

And the result is stored in a table called EMP_DEPT.

For this i had created a data store with the name EMP_DEPT with all columns from EMP data store and two columns LOC and DNAME from DEPT.

The interface KM option "Create Target Table" is set to true to create target table at run time.

Hope this will useful to understand some good features of ODI 





Thanks ,

ODI FILTER

Hi Gurus,


Today let us see the video how the filter transmission is implemented using ODI.

In this example i took EMP table as my source where i applied the filter condition.


I hope you enjoy the vedio.



Thanks Gurus,

Ram kumar Lanke

Thursday, 20 October 2011

Creating ODI Data server


Hi Guru,
Today Let us discuss how to create the data server in ODI.
Data servers describe connections to your actual physical application servers and databases.

They can represent for example:

• A Teradata System
• An Oracle Instance
• An IBM DB2 Database
• An IBM DB2 iSeries Instance
• A Microsoft SQL Server Instance
• A Sybase ASE Server
• A Websphere MQ router
• A File System
• An XML File
• A Microsoft Excel Workbook
• etc.

Below is the definition of an oracle data server

 
           To create a Data Server we need the following prerequsites
1. Admin user name and password for the database server
2. jdbc url

For example i have oracle database installed in my local server ODIGURU

. Then in order to create dataserver for the local database i need the following

1. Database connection admin credentials

User name: system
password: sysdba

2. Database jdbc url

jdbc:oracle:thin:@ODIGURU:1521:orcl

where ODIGURU is the hostname of my database server
1521 is the port number
orcl is the database connect string

The following are the steps to create data server

Step-1 : open Topology Navigator expand the Technologies node in the Physical Architecture accordion.

step-2: Select the technology you want to create a data server for.

Step3: Right-click and select New Data Server



Give the following details in the Definition tab:

Name: ORACLE_DEMO
 the following naming standard is used to name the data server: <TECHNOLOGY_NAME>_<SERVER_NAME>.

Data Server: For Oracle, this name corresponds to the name of the instance, used for accessing this data server from another Oracle data server through DBLinks.

User/Password:
This parameter is not mandatory for all technologies, as for example for the File technology.
User name and password for connecting to the data server

for this example:

User name: system
password: sysdba


 

 For some connections using the JNDI protocol, the user name and its associated password can be optional if they have been given in the LDAP directory

Connection parameters for the data server:
Two methods:
1. A technology can be accessed directly through JDBC
2. or the JDBC connection to this data server can be served from a JNDI directory.
for this example:



Database jdbc url:

jdbc:oracle:thin:@ODIGURU:1521:orcl