etl bi dw.pptx

BI, DW and ETL
Basic concept and architecture
Sid Xing
BI and DW
Architecture
ETL concepts what is ETL?
Purpose of ETL Why ETL?
Process of ETL and How?
BI Solutions Introduction
Resource
AGENDA
BI and DW
Architecture
ETL concepts what is ETL?
Purpose of ETL Why ETL?
Process of ETL and How?
BI Solutions Introduction
Resource
AGENDA

Business Intelligence
Business Intelligence, is a system engineering which is supported by data warehouse, ETL as process, and reporting as presentation. It helps business decision makers and analysts get to know business status, find out implicit business patterns, enhance business quality and forecast business trends.
“Business Intelligence is the process of transforming data into information and through discovery transforming that information into knowledge.”
Gartner Group
Decision
Knowledge
Information
Data
BI Famous Case -- Wal-Mart
Beer for father
Nappy for baby
Data Warehouse
“A data warehouse is a subject oriented, integrated, non-volatile, and time variant collection of data in support of management’s decisions.”
— Bill Inmon
DW is a PROCESS, NOT a PRODUCT
Business Intelligence Architecture
Metadata
Management
ODS
DW
Interface
CUBE
System
Management
Finance
CRM
Resource
External
Interface format
Management
ETL Rule
Management
Data Quality
Management
Security
Management
Log
Management
Monitor/Alert
Interface
Management
Report
Metadata
Business
Metadata
Scheduler
report
Data Mart 1
Data Mining
Data Mart 2
Audit
ETL
ETL
ETL
ETL
ETL
ETL
Presentation
Operational
ETL concepts
E – Extract – Get original data from source database(normally it’s operational db), the foundation of all the other jobs.
T – Transform – Clean and conform data based on business requirement, the plicated part of the whole ETL process.
L – Load – Import data which has been properly processed into target database, incrementally or all-together.
A properly designed ETL system extracts data