When we install BODI s/w the follow standard Data Integrator components are going to be installed
- Data Integrator Designer
- Data Integrator Engine
- Data Integrator Administrator
- Data Integrator Repository
- Data Integrator Services
- Data Integrator Job Server
- Data Integrator Access Server
- Data Integrator Web Server
- Data Integrator SNMP Agent
- Data Integrator Metadata Reporting Tool
Components of Data Integrator and their relationships
Following are the Data Integrator standard components
Designer is a GUI based client tool or development tool that allows you to create, test and execute jobs that populates to Data warehouse.
The designer GUI allows you to define data management applications that consist of data mappings, transformations and control logics. You will use the designer to create the objects that represents data source, target table definitions and the transformation rule.
When DI jobs are executed the job server starts the DI engine process to perform extraction transformation & moment.
The DI engine process use parallel pipelining and in memory data transformation to delivers scalable high data throughput.
The Administrator provides you to
- Scheduling, monitoring, and executing batch jobs
- Configuring, starting, and stopping real-time services
- Configuring Access Server, and repositories
- Configuring and managing adapters
- Managing users for Secure central repositories, Profiler repositories
A repository is a central storage place which contains all the necessary information to build the data mart or data warehouse. The DI repository is a set of tables that holds user created and system define objects, source & target metadata and transformation rules.
A repository is setup an open client server platform to share the metadata with other enterprise tools. DI repository is created on RDBMS, there are two types of repositories
It is used by application designer to store definitions of DI objects like
Projects, Jobs, Workflows, Dataflows, Source & Target metadata.
A central repository is an optional component that can be used to support multiuser environment. It provides a shared object library allowing developers to check objects in the repository.
When you install DI on your windows platform two services will be installed
- DI Service: It starts the job server and access server automatically when system starts.
- DI Web Server: It supports web-based applications like DI Admin and Metadata reporting tool.
DI Job Server
The DI job server starts the data moment engine that integrates the data from multiple heterogeneous sources, performs complex data transformations, manages extraction and transaction from ERP system.
The DI job server can move the data either in batch/real time mode, uses distributed query optimization, multi threading, In memory caching, transaction and parallel pipelining to deliver high data throughput and scalability.
DI Access Server
It is a real-time request reply message broker that collects the message request roots them to real-time service & delivers a message reply with in user specified time frame.
The access server maintains the queue of messages and senses them to next available real-time service across any number of computing resources.
DI Web Server
It supports web-based applications like DI Admin and Metadata reporting tool. Al_JobService is for Unix platform
DI SNMP (Simple Network Management Protocol) Agent
DI error events can be communicated using SNMP supported applications for better error monitoring. Install DI SNMP agent on any other computer running the server.
DI SNMP agent monitors & records information about job server and the jobs running on the computer.
DI Metadata reporting tool
This tool provides browser based reports on DI metadata which is stored in repository. These reports provides
Impact and Lineage analysis
It includes the following:
- Repository summaries
We can view the reports on Projects, Jobs, WF’s, DF’s, Datastores, Custom transforms, File formats, Custom functions in the repository
- Data store analysis
We can view the reports on database connection information view overviews, tables and functions.
- BO universe analysis
For every configured universe can create reports on classed, objects and other objects in the universe.
- Dependency analysis
Search for a specific object in your repository and understand how impact on the objects by other objects in the universe
It captures the repository information of all the objects like projects, jobs, WF’s, DF’s etc., and can prepare a report, can take a print outs as well.
Operational Dash Boards
This kind of reports provides graphical representation of DI job execution statictics, job execution duration and execution, duration statistics histories.
This kind of reports provides graphical representation of DI validation rules that you created in batch jobs. We can identify inconsistencies or errors in source data.
Note: To gain more knowledge on these components, just go through the technical manuals throughly, i got it from there.