What do you think of this post?
  • Awesome 
  • Interesting 
  • Useful 
 

Click on the arrow icon beside each category to display or hide all items within the chosen category. Summaries of each page may be hidden or shown by clicking the plus icon next each item. Use the Options menu to expand or contract all items, display or hide summaries or sort the table of contents.

Options   

Table of Contents

Static Pages

  • About Me 

    January 30, 2009, 00:23

    Welcome !!! Hey folks, Welcome to my blog (A tiny technical reference). I'm an IM(Information Management) specialist, hails from Southern Part of India. I'm…

    • mycv 

      February 24, 2016, 20:48

  • Data Warehousing 

    December 15, 2008, 17:42

    Overview A Data Warehouse has been used to refer to a database that contains very large stores of historical data. The data is stored as a series of…

    • AVG 

      November 29, 2008, 04:53

      The AVG() Function The AVG() function returns the average value of a numeric column. SQL AVG() Syntax SELECT AVG(column_name) FROM table_name  …

    • COUNT 

      November 29, 2008, 04:55

      The COUNT() function returns the number of rows that matches a specified criteria. SQL COUNT(column_name) Syntax The COUNT(column_name) function returns…

    • Cube 

      June 27, 2011, 04:25

        A cube is mainly used for multi-dimensional analysis. The below questions can be answered if we have collected considerable amount of data What…

    • Data Integration 

      January 17, 2009, 19:00

      Data Integration Pulling together & reconciling dispersed data for analytic purpose that organizations have maintained in multiple hetrogenous systems. D…

    • Data Mart 

      December 16, 2008, 00:09

        Data Mart It is a subset of data warehouse and it supports a particular region, business unit like Sales, Marketing, HR, Finance. DW's and DM's are…

    • Data Mining 

      February 3, 2009, 17:56

      It is the process of analyzing data from different perspectives and summarizing it into useful information.

    • Data Warehouse in the Insurance Industury 

      July 28, 2009, 18:11

      Data Warehousing in the Insurance Industry, A Strategic Advantage: Designing High-Performance DSS Databases One of the biggest challenges in building…

    • Data Warehouse Life Cycle 

      December 16, 2008, 13:23

        Phase I Project Plan and Scope of the Project There are three parameters to be consider    Scope Time Resource     Scope  What you would…

    • Data Warehouse vs Data Mart 

      December 17, 2008, 00:34

        Data Warehouse DWH focuses on enterprise data across many subject areas It stores large volume of data and maintains historical information.     A…

    • Different methods of loading data 

      December 15, 2008, 23:47

        There are two different ways to load data in dimension tables. Conventional Load (Slow) Direct Load (Fast) Conventional Load (Slow) All the…

    • ELT (Extract, Load and Transform) 

      December 18, 2008, 13:12

      ELT (Extract, Load and Transform)

    • Enterprise Data Model 

      December 15, 2008, 17:53

        An Enterprise Data Model (EDM) represents a single integrated definition of data, unbiased of any system or application. It is independent of "how" the…

    • ETL 

      December 16, 2008, 21:12

      ETL (Extraction, Transform and Load) ETL is technique that enables business to consolidate their disparate data while moving it from place to place, and it…

    • Fundamental Stages of DWH 

      December 15, 2008, 23:20

        Offline Operational Databases In this initial stage, simply copying the database of an operational system to an off-line sever where the processing load of…

    • HIPAA - Health Insurance Portability and Accountabilty Act 

      April 1, 2009, 00:17

      HIPAA - Health Insurance Portability and Accountabilty Act

    • Late Arrivals 

      November 29, 2010, 05:54

      Ralph Kimbal's explaination about late arrivals http://www.rkimball.com/html/designtipsPDF/KimballDT57EarlyArriving.pdf What do you do when you receive…

    • Logical versus Physical Design 

      January 21, 2009, 12:53

        After all business requirements have been gathered for a proposed database, they must be modeled. Basically, data modeling act like a bridge between…

    • MAX 

      November 29, 2008, 04:57

      The MAX() Function The MAX() function returns the largest value of the selected column. SQL MAX() Syntax SELECT MAX(column_name) FROM table_name …

    • Measure and Facts 

      June 27, 2011, 05:35

      A fact table in data warehousing contains measures, metrics of a business and dimensional surrogate keys surrounded by dimension tables in a Star/Snow-flake…

    • Metadata 

      January 19, 2009, 18:35

        It is nothing but "Data about data", any data maintained to support the operation or use of data warehouse. It describes how and when by whom a particular…

    • MIN 

      November 29, 2008, 04:58

      The MIN() Function The MIN() function returns the smallest value of the selected column. SQL MIN() Syntax SELECT MIN(column_name) FROM table_name …

    • Normalization Vs Denormalization 

      November 29, 2008, 04:03

      27ad2ec5-117c-4ba7-a05a-f35bfd2df0ff When most of us design our databases we tend to think of them as related (and un-related) tables that contain data. It is…

    • OLTP, OLAP 

      December 16, 2008, 20:27

        OLTP (On-Line Transaction Processing) This system is an application that modifies data the instance it receives and has a large number of concurrent…

    • Operational Data Store(ODS) 

      December 15, 2008, 23:28

      Operational Data Store A database structure that is a repository for a near real-time data rather than long term data. The ODS may further become the…

    • Operational Vs Historical 

      January 19, 2009, 16:56

        Operational systems are designed to support Transaction Processing whereas Data Warehouse systems are designe to support  Online analytical Processing  …

    • Referential Constraints 

      January 27, 2009, 15:16

        In the context of relational databases, a foriegn key is a referential constraint between two tables.  The foriegn key identifies a column or a set of…

    • Repository 

      December 16, 2008, 12:10

        Repository A repository combines multiple data sources into one normalized database. The records in a repository are updated frequently. Data is operationa…

    • SCD - Slowly Changing Dimensions 

      July 28, 2009, 18:07

      Implementing SCD’s is common concern in Data Warehouse design. Let me brief about different types of SCD’s first then we can step in to SCD’s design. Dim…

    • Snowflak Schema 

      December 19, 2011, 00:53

      Snowflake Schema Extension of Star Schema where the Dimension Tables are normalized. E.g. The dimension table Product has manufacturing plant , location of…

    • Star Schema 

      December 19, 2011, 00:20

      Star Schema In Star schema , dimensional data (describing how data is commonly aggregated) is separated from Fact or event data (describing individual…

    • STDDEV 

      November 29, 2009, 05:06

      Returns the sample standard deviation of an expression STDDEV( <expression>) OVER (<analytic_clause>) conn oe/oe col stddev format…

    • SUM 

      November 29, 2008, 04:59

      The SUM() Function The SUM() function returns the total sum of a numeric column. SQL SUM() Syntax SELECT SUM(column_name) FROM table_name   …

    • Summary Tables 

      October 20, 2009, 01:52

      Summary Tables A common technique used in data warehouse is prior computation and store results of some frequent SQl's. This is useful when the queries are…

    • VARIANCE 

      November 29, 2009, 05:08

      VARIANCE Returns the variance of an expression VARIANCE( <value>) OVER (<analytic_clause>) conn oe/oe SELECT last_name, salary, VARIANC…

  • DataBase 

    January 15, 2009, 13:16

    A database is a structured collection of records or data that is stored in a computer system. The structure is achieved by organizing the data according to a…

    • ASCII Table 

      March 21, 2009, 04:35

      ASCII / American Standard Code for Information Interchange   ASCII is the standard code used for information interchange and communication between data…

    • Codd's 12 Rules 

      January 15, 2009, 13:05

        Codd's 12 rules are a set of thirteen rules (numbered zero to twelve) proposed by Edgar F. Codd, a pioneer of the relational model for databases,…

    • Conceptual Model 

      January 17, 2009, 18:19

      The conceptual model is concerned with the real world view and understanding of data. It typically includes only significant entities which have business…

    • Normalization 

      January 21, 2009, 16:34

        Normalization is the process of efficiently organizing data in the database. Normalized data must be in "relational" data structure. Why "Normalize"…

    • SQL Constraints 

      November 26, 2008, 04:44

      1bb4e641-5c29-46e1-9302-d1032e9caad5  Constraints are used to limit the type of data that can go into a table. Constraints can be specified when a table…

      • SQL Check Constraint 

        November 26, 2008, 06:23

        SQL CHECK Constraint The CHECK constraint is used to limit the value range that can be placed in a column. If you define a CHECK constraint on a single…

      • SQL Default Constraint 

        November 26, 2008, 06:26

        SQL DEFAULT Constraint The DEFAULT constraint is used to insert a default value into a column. The default value will be added to all new records, if no…

      • SQL Foreign Key Constraints 

        November 26, 2008, 06:20

        SQL FOREIGN KEY Constraint A FOREIGN KEY in one table points to a PRIMARY KEY in another table. Let's illustrate the foreign key with an example. Look at…

      • SQL NOT NULL Constraint 

        November 26, 2008, 04:53

        1bb4e641-5c29-46e1-9302-d1032e9caad5  The NOT NULL constraint enforces a column to NOT accept NULL values. The NOT NULL constraint enforces a field to…

      • SQL Primary Key Constraint 

        November 26, 2008, 06:16

        SQL PRIMARY KEY Constraint The PRIMARY KEY constraint uniquely identifies each record in a database table. Primary keys must contain unique values. A…

      • SQL Unique Constraint 

        November 26, 2008, 05:35

          SQL UNIQUE Constraint The UNIQUE constraint uniquely identifies each record in a database table. The UNIQUE and PRIMARY KEY constraints both provide a…

    • Types of Databases 

      January 15, 2009, 18:05

      These days when we talk about databases in the wild, we are mostly talking about two types of databases Analytic Database Operational Database Analytic…

    • What is RDBMS? 

      February 2, 2009, 16:52

      RDBMS stands for Relational Database Management System. RDBMS data is structured in database tables, fields and records. Each RDBMS table consists of database…

  • ETL Tools 

    August 27, 2015, 04:11

    An ETL tool offers functionality to extract, transform and load data from one system (aka: the source) into another system (aka: the target). ETL tools are…

    • SAP Data Services 

      December 12, 2008, 13:16

      SAP Business Objects Data Services  Overview Data Services is a GUI based ETL tool from SAP Business Objects. It is a client server technology and an…

      • Case Transform 

        February 6, 2009, 17:19

        This transform defines different rows in different manners

      • Configuring Repository with Job Server 

        January 14, 2009, 16:48

        Open the Server Manager Start--> Programs--> BusinessObjects DataIntegrator--> Server Manager Server Manager window will be opened,…

      • Creation of Local Repository 

        January 13, 2009, 18:50

        1. To create a DI Oracle local repository, first of all we need to log logon to oracle sys account Connect SYS/SYS AS SYSDBA 2. Now we have to create…

      • Cummulative Measure 

        February 13, 2009, 13:14

        Calculating a cummulative measure is common query in DW, but there is no straight forward way in DI. Either you have to write a custom function or you have to…

      • Date_Generation Transform 

        February 7, 2009, 02:02

        Produces a series of dates incremented as you specify

      • DI Architecture 

        December 15, 2008, 18:05

          DI Architecture   Mainly i want to discuss about Designer, Engine, Jobserver, and Repository 1. DI Designer is to design your job and save it to a local…

      • DI Central Repo vs IBM's Rational ClearCase (Version Controlling) 

        May 1, 2009, 01:06

        Central Repo Version Control Comparision

      • DI Components 

        December 15, 2008, 18:08

        When we install BODI s/w the follow standard Data Integrator components are going to be installed Data Integrator Designer Data Integrator Engine…

      • DI Repo Password Encryption 

        February 18, 2009, 17:44

        To encrypt your repo password, follow the steps Start-> Run -> CMD (command prompt) Browse Data Integrator   <LINK_DIR>\Bin  Directory …

      • ETL Tool Comparison 

        April 12, 2009, 13:49

          When we browse any forum/discussion groups, people used to ask few common questions. Has anyone compared different ETL Tools in the market? Do…

      • Flatfile Lookup 

        February 12, 2009, 18:19

        Performing a lookup on a flatfile isn't a bid deal in DI. Here is the way to go, follow the steps. Here, EMP (Table) is my source and DEPT (Flatfile)…

      • How can I see complete Workflow/Dataflow names in the workspace 

        August 12, 2009, 00:07

        Sometimes we cannot avoid longish names for DI WF/DF objects because we need to follow naming conventions. I can't read the whole name in the workspace…

      • How to get job execution statistics using repository tables. 

        February 23, 2009, 03:36

        I have written few quries to fetch the status information of jobs Fire these below queries against your repository database -----------------------------…

      • How to import atl into repository using al_engine 

        July 8, 2009, 11:38

        Importing atl file into repository using script. RepoServerName= RepoDatabaseName= DatabaseType= RepoUserName= RepoPassword= ATLFile…

      • How to view more than 1000 records in View data section window 

        August 11, 2009, 23:38

        My source table has  4500 records and I processed same set of data to target table. I was checking the data in 'View data' section of both the soruce and…

      • Key_Generation Transform 

        February 23, 2009, 01:18

        When creating a dimension table in a data warehouse, we generally create the tables with a system generated key to unqiuely identify a row in the dimension.…

      • List of ETL Tools 

        May 2, 2009, 05:11

        No description found for this item.

      • Loading DI Error, Monitor, Trace files into a table 

        February 21, 2009, 20:11

        Sometimes we need to write error details(like error number, description) into table. Let us say, a job is being executed, an error occured in the middle of…

      • Lookups in SAP BODI/DS 

        January 20, 2011, 06:19

        What is a Lookup table? In DW terminology, Lookup is the common practice in ETL operations to get the appropriate value from a lookup table/referenced data…

      • Map_Operation Transform 

        February 16, 2009, 18:41

        Allows conversions between operation codes.

      • Merge Transform 

        February 6, 2009, 18:08

        Combines two or more schemas as a single schema

      • Migration of Repositories (Export/Import) 

        April 3, 2009, 18:51

        In general, we use to migrate our repo's mainly in three different phases (Devlopment, Testing and Production). Each environment might have different…

      • Multiple Datastore Configs - System Configs 

        April 10, 2009, 22:50

        Well, sometimes we need to read data from different sources  For this you need to create multiple configurations on single datastore and System configurati…

      • Naming Conventions 

        August 23, 2009, 20:23

        When designing an ETL code using Data Integrator/Data Services its always a good idea to follow some sort of naming conventions. The following are some…

      • Pivot Transform 

        February 11, 2009, 18:18

        Note on Pivot: This creates a new row for every value that you specified as a pivot column. Observe the icon, it says that will convert column to rows.…

      • Query Transform 

        May 4, 2009, 06:26

        Query Tranformation

      • Repository Creation using Batch script 

        February 2, 2009, 11:58

          We can create repository using batch script, blend the below script in your batch file. This would work like a silent repo creation   REPOMANBATCH -U…

      • Reverse Pivot Transform 

        May 4, 2009, 11:07

        Note on Reverse Pivot: This transform converts rows in to columns. It will group the data-set of different rows in to a single row with different columns. Obse…

      • Row_Generation Transform 

        February 7, 2009, 03:07

        Produces a data set with a single column. Values start from zero and increment by one to a specified number of rows.

      • Significance of Overflow option? 

        February 12, 2009, 16:18

        "Overflow" is an option used for error handling. You cannot expect quality(valid) data everytime, sometimes we might get bad rows also, hence an error would…

      • SQL Transform 

        February 9, 2009, 13:30

        Performs a specified SQL query operation

      • Toolbar doesn't allow docking 

        August 16, 2009, 20:04

        Oneday, I was changing my DI designer appearance (moving standard toolbar from oneplace to another, project explorer window etc.,) somehow I got an error, I…

      • What's new in BODI 11.5 Release 

        February 2, 2009, 12:24

        Here i jotted some points that what i have observed in the BODI XI (11.0, 11.1, 11.5). New Transformations Address_Enhancement Name_Parsing Match_Merge …

      • What's new in BODI 11.7 Accelerated 

        February 24, 2009, 03:02

        Many points to discuss, but i will write few points that's what I have observed so far.... New Transformations Data_Transfer Data Quality transformations…

      • XML_Pipeline Transform 

        February 9, 2009, 18:15

        Note on XML_Pipeline Transform: This deals with XML Sources and process large XML files into smaller pieces. Options: No Options for this transform Rules: …

  • Google Search 

    March 22, 2011, 02:06

    google.load("elements", "1", {packages: "transliteration"});

  • Links 

    March 26, 2009, 02:47

    You can find useful websites links here Data Integrator Forums BusinessObjects Board ITToolbox DI Tips n Tricks (Werner's Wiki) DS SAP…

  • Site Map 

    December 18, 2011, 23:43

    This page contains the site table of contents. Use it to quickly find content on this website.


Blog Posts


What do you think of this post?
  • Awesome 
  • Interesting 
  • Useful