tag:blogger.com,1999:blog-23877311029084213902024-03-05T17:00:25.983+05:30Data WareHouseLearn the in-depth concepts of data warehouse by a computer science engineer Kunal from India.Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.comBlogger13125tag:blogger.com,1999:blog-2387731102908421390.post-70270272550690231622008-01-28T22:19:00.000+05:302008-01-28T22:29:17.376+05:30ETL ToolETL stands for Extract, Transform, Load is Data Warehouse acquisition processes that involves<br /><ul><li>Extract the data from outside sources.</li></ul><ul><li>Transform the data to fit business needs and ultimately</li></ul><ul><li>Load the the transform data to the data warehouse.</li></ul>For example:<br /><ol><li>Informatica.</li><li>Data Stage.</li><li>Oracle warehouse builder.</li><li>Ab initio.<br /></li></ol>ETL can also be used for the integration with legacy systems. ETL is the Data Warehouse acquisition processes of Extracting, Transforming and Loading data from source systems into the data warehouse.Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com2tag:blogger.com,1999:blog-2387731102908421390.post-30402030194043021752008-01-28T21:46:00.000+05:302008-01-28T22:01:54.017+05:30OLAP (On Line Analytical Processing)<div style="text-align: justify;"><span style="font-weight: bold;">OLAP may employ multidimensional DBMS to allow users to:</span><br /><br /></div><ul><li>View data from many different view point. </li></ul><ul><li>Easily switch from one view point to another.</li></ul><ul><li>Drill down in to the data with a parent-child relationship between the data point.</li></ul><ul><li>Solve modern business problem such as market analysis and financial for casting.</li></ul>Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com1tag:blogger.com,1999:blog-2387731102908421390.post-6197156988951396542008-01-25T10:26:00.000+05:302008-01-25T10:40:15.643+05:30Data Warehouse Advantages<div align="justify"><strong>Data warehouse has a lots of advantages, some of them are given below:</strong><br /><br /><ul><li>Data warehouses provide a better access to end-user on variety of data’s.</li></ul><ul><li>Users can get specified Decision support system for reports, e.g. information about the particular item is purchasing or being sold in a particular area within a month or year.</li></ul><ul><li>Data warehouse is a very important enabler of commercial business applications, particularly customer relationship management (CRM) systems.<br /></li></ul><br /></div><ul><li><br /></li><li><br /></li></ul>Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com0tag:blogger.com,1999:blog-2387731102908421390.post-11344747698301101432007-10-02T23:02:00.000+05:302007-10-02T23:08:10.082+05:30Data query and reporting tools<p class="MsoNormal">Query and reporting tools are divided in to two parts.<o:p><br /></o:p></p> <ul style="margin-top: 0in;" type="disc"><li class="MsoNormal" style="">Reporting tools</li><li class="MsoNormal" style="">Managed query tools</li></ul> <p class="MsoNormal"><o:p> </o:p><b style="">Reporting tools</b> further dividing in to two parts.<o:p><br /></o:p></p> <ul style="margin-top: 0in;" type="disc"><li class="MsoNormal" style=""><b style="">Production reporting tools</b> will let companies generate regular operational reports or support high level batch job, such as calculating and printing paychecks.</li><li class="MsoNormal" style=""><b style="">Report writer, </b>on the other hand, are expensive desktop tools designed for end users.</li></ul> <p class="MsoNormal"><o:p> </o:p><b style="">Managed query tools </b>protect end users from complexities of SQL and database structure by inserting a <st1:place st="on">Meta</st1:place> layer between user and the database. </p> <p class="MsoNormal"><st1:place st="on">Meta</st1:place> layer is software that provides subject oriented view of database and support point-and-click creation of SQL. </p> <p class="MsoNormal">These tools are designed for easy-to-use point–and-click and visual navigation operations that either accept SQL or generate SQL statements to query relational data stored warehouse.</p> <p class="MsoNormal">Some of these tools are used to format the received data in to easy-to-read report.</p>Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com1tag:blogger.com,1999:blog-2387731102908421390.post-5515542595862274892007-10-02T22:55:00.000+05:302007-10-02T23:10:00.005+05:30Data Warehouse Access Tools<p class="MsoNormal">The principal purpose of data warehousing is to providing information to business users for strategic decision making. </p> <p class="MsoNormal">These users interact with data warehouse using front-end tools. Although regular reports and custom reports are the primary delivery vehicles for analysis done in most data warehouse, many development efforts in data warehouse arena are focusing on exceptional reporting also known as <i style="">alerts.<o:p></o:p></i></p> <p class="MsoNormal"><b style="">Example:</b> If the data warehouse designed for accessing the risk for currency treading, an alert can be activated when a certain currency rate drops below a predefined threshold.</p> <p class="MsoNormal"><o:p></o:p><span style="font-weight: bold;">Access tools</span> can be divided in to five main groups.<br /><o:p> </o:p></p> <ul style="margin-top: 0in;" type="disc"><li class="MsoNormal" style=""><a href="http://kunal-dw.blogspot.com/2007/10/data-query-and-reporting-tools.html">Data query and reporting tools</a>.</li><li class="MsoNormal" style="">Application development tools.</li><li class="MsoNormal" style="">Executive information system (EIS) tools.</li><li class="MsoNormal" style="">Data mining tools.</li></ul>Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com0tag:blogger.com,1999:blog-2387731102908421390.post-90018105267756032612007-09-30T23:13:00.000+05:302007-10-01T01:47:48.700+05:30Three-Tier Architecture of Data Warehouse<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgk38R0HQj0y2OID_hjN16LZqkdLx7_hqTJuaLfh-5seDIDCnj0e1jKHGILOW-Hv0c_erDuiHpVmS_qvwDvM34x5O666Hhy06eryU2OXbIubg8AQhYOEpgSHXZnae5P-09UMuZgyCdtRAQ/s1600-h/3tadw.JPG"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgk38R0HQj0y2OID_hjN16LZqkdLx7_hqTJuaLfh-5seDIDCnj0e1jKHGILOW-Hv0c_erDuiHpVmS_qvwDvM34x5O666Hhy06eryU2OXbIubg8AQhYOEpgSHXZnae5P-09UMuZgyCdtRAQ/s400/3tadw.JPG" alt="" id="BLOGGER_PHOTO_ID_5116055421785376738" border="0" /></a><span style="font-weight: bold;">Client:-</span><br /><br />* GUI/Presentation logic<br />* Query specification<br />* Data Analysis<br />* Report formatting<br />* Data access<br /><br /><span style="font-weight: bold;">Application/Data Mart Server:-</span><br /><br />* Summarizing<br />* Filtering<br />* Meta Data<br />* Multidimensional view<br />* Data access<br /><br /><span style="font-weight: bold;">DW Server:-</span><br /><br />* Data logic<br />* Data services<br />* Meta data<br />* File servicesKunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com0tag:blogger.com,1999:blog-2387731102908421390.post-29374360088032696032007-09-30T22:53:00.000+05:302007-10-01T01:46:49.790+05:30Two-Tier Architecture of Data Warehouse<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjx_P1JmxyNkGabLAG9Jpl6sWUSTyh8Xhm-newWBlJpIckh_WMGu4ixfJh9lYt6b9Q2F5SmeAZkiMC0VIIEcyAME7t_yx1x9QdQXptkYp5TeVW_8tH58GoRi4HqOQbWxelkGYZFPly0MQ0/s1600-h/2tadw.JPG"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjx_P1JmxyNkGabLAG9Jpl6sWUSTyh8Xhm-newWBlJpIckh_WMGu4ixfJh9lYt6b9Q2F5SmeAZkiMC0VIIEcyAME7t_yx1x9QdQXptkYp5TeVW_8tH58GoRi4HqOQbWxelkGYZFPly0MQ0/s400/2tadw.JPG" alt="" id="BLOGGER_PHOTO_ID_5116049915637303250" border="0" /></a><br /><br /><span style="font-weight: bold;">Client:-</span><br /><br />* GUI/Presentation logic<br />* Query specification<br />* Data analysis<br />* Report formatting<br />* Summarizing<br />* Data access<br /><br /><span style="font-weight: bold;">DW Server:-</span><br /><br />* Data logic<br />* Data services<br />* Meta data<br />* File servicesKunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com11tag:blogger.com,1999:blog-2387731102908421390.post-83621681155281292872007-09-28T21:54:00.001+05:302007-09-28T22:28:26.006+05:30Multidimensional Data Model<img src="file:///C:/Documents%20and%20Settings/kunal/My%20Documents/My%20Pictures/cubes1.JPG" alt="" /><img src="file:///C:/Documents%20and%20Settings/kunal/My%20Documents/My%20Pictures/cubes1.JPG" alt="" /><br />Multidimensional data model is to view it as a cube. The cable at the left contains detailed sales data by product, market and time. The cube on the right associates sales number (unit sold) with dimensions-product type, market and time with the unit variables organized as cell in an array.<br /><br />This cube can be expended to include another array-price-which can be associates with all or only some dimensions.<br /><br />As number of dimensions increases number of cubes cell increase exponentially.<br /><br />Dimensions are hierarchical in nature i.e. time dimension may contain hierarchies for years, quarters, months, weak and day. GEOGRAPHY may contain country, state, city etc.<br /><br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg0lLUSN7x6Uz2C1Ok5EVczYypvjPvaKwz-tGexbgxnAB_mZqsE4XyfqOg1t2Z6lNJls4PSqUghQjhgO8OmW32VtzyYqKetEpd9FpiPFHS6KFbFTdyq8nklkx3qb2DXl9rYP-qrZZkWTXk/s1600-h/cubes1.JPG"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg0lLUSN7x6Uz2C1Ok5EVczYypvjPvaKwz-tGexbgxnAB_mZqsE4XyfqOg1t2Z6lNJls4PSqUghQjhgO8OmW32VtzyYqKetEpd9FpiPFHS6KFbFTdyq8nklkx3qb2DXl9rYP-qrZZkWTXk/s400/cubes1.JPG" alt="" id="BLOGGER_PHOTO_ID_5115298648547821490" border="0" /></a><br /><br /><a href="http://kunal-dw.blogspot.com/"><br />Data WareHousing</a>Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com4tag:blogger.com,1999:blog-2387731102908421390.post-43765164318920168932007-09-28T04:56:00.000+05:302007-10-04T23:40:49.028+05:30Meta Data in Data Warehouse<span style="font-weight: bold;">Meta Data</span> is one of the most important aspect of data warehousing. It is the data about data stored in data warehouse and its users.<br /><br /><span style="font-weight: bold;">Meta Data</span> provides decision-support-oriented pointer to warehouse data and thus provide logical link between warehouse data and decision support application.<br /><br /><span style="font-weight: bold;">Meta Data</span> is the key to providing user and application with a road map to the information stored in the warehouse.<br /><br /><span style="font-weight: bold;">Meta Data</span> can define all attributes, data sources and timing, and rules that govern data use and data transformation of all data elements.Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com0tag:blogger.com,1999:blog-2387731102908421390.post-91286338919418438302007-09-28T04:27:00.000+05:302007-09-28T22:29:45.950+05:30Data Warehouse Architecture<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjdZv2KJkGawOvIXQkpIdUUt_ow4PTLZOcfnWMji6BQou2RIPBTsoFy8FzGA7DNY1uMR2ES14gmSzVwcA1U47oc5dhIZ5WmLw5Ud42evxaTj67ClK4xQ1tGuEvPQ68Ypj9NKRJwTEoXLts/s1600-h/DWA.JPG"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjdZv2KJkGawOvIXQkpIdUUt_ow4PTLZOcfnWMji6BQou2RIPBTsoFy8FzGA7DNY1uMR2ES14gmSzVwcA1U47oc5dhIZ5WmLw5Ud42evxaTj67ClK4xQ1tGuEvPQ68Ypj9NKRJwTEoXLts/s400/DWA.JPG" alt="" id="BLOGGER_PHOTO_ID_5115028426385426322" border="0" /></a>Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com0tag:blogger.com,1999:blog-2387731102908421390.post-42583521538914811712007-09-28T01:29:00.000+05:302007-09-28T22:29:45.950+05:30Types of Data WarehouseThere are mainly three type of Data Warehouse.................<br /><br /><span style="font-weight: bold;">1).</span> Enterprise Data Warehouse.<br /><span style="font-weight: bold;">2). </span>Operational data store.<br /><span style="font-weight: bold;">3). </span>Data Mart.<br /><br /><span style="font-weight: bold;">Enterprise Data Warehouse </span>provide a control Data Base for decision support through out the enterprise.<br /><br /><span style="font-weight: bold;">Operational data store</span> has a broad enterprise under scope but unlike a real enterprise DW. Data is refreshed in rare real time and used for routine business activity.<br /><br /><span style="font-weight: bold;">Data Mart</span> is a sub part of Data Warehouse. It support a particular reason or it is design for particular lines of business such as sells, marketing or finance, or in any organization documents of a particular department will be data mart<br /><br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi1SNdxnJPkPYAxDsl8Vvsx9qe3tkJcXbO92r4n-83OdNjLg5Q9XHME3WgSo2Q9KcFyAT1vXgY6_Md6acecRjfeVl9fkbyeoGa1hESagdTALBLhNjgXeuubU3HhRv4dToEt9Slyc6czjIg/s1600-h/Data+Mart..bmp"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi1SNdxnJPkPYAxDsl8Vvsx9qe3tkJcXbO92r4n-83OdNjLg5Q9XHME3WgSo2Q9KcFyAT1vXgY6_Md6acecRjfeVl9fkbyeoGa1hESagdTALBLhNjgXeuubU3HhRv4dToEt9Slyc6czjIg/s320/Data+Mart..bmp" alt="" id="BLOGGER_PHOTO_ID_5114986507504617282" border="0" /></a>Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com3tag:blogger.com,1999:blog-2387731102908421390.post-29844498784364350352007-09-28T00:33:00.000+05:302007-09-28T22:29:45.950+05:30Difference Between Data Warehouse and Data Base<span style="font-weight: bold;">1).</span> Data Base (DB) is a place where data is taken as the base and manage to get a valuable for fast and efficient access.<br /><br />Where as Data warehouse (DW) is the place where the application data is manage for analysis and reporting purpose.<br /><br /><span style="font-weight: bold;">2).</span> Data Base is used for transactional purpose. It is volatile in nature i.e. value can change in DB.<br /><br />Where as historical data is maintained in DW, instate of keeping it in real time OLTP (Data Base) system.<br /><br /><span style="font-weight: bold;">3).</span> Data Base stores data in the form of table. Data is accessed by giving a query.<br /><br />Data Warehouse is also a DB but the purpose is for business analysis and it is used to store historical data.<br /><br /><span style="font-weight: bold;">4).</span> Transactional Data Base is RDB (relational database) with the normalize table.<br /><br />Where as Data Warehouse contain complete data link past and present based on OLTP system with d normalize table.Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com1tag:blogger.com,1999:blog-2387731102908421390.post-65227275204595533472007-09-26T01:29:00.000+05:302007-09-26T01:47:37.521+05:30Data WarehouseData warehouse is a collection of historical data as well as current data.<br /><br />Data warehouse is defined with the help of subject-oriented, time-variant, non-volatile and integrated data.<br /><br /><dl><dt><span style="font-weight: bold;">Subject-oriented</span> </dt><dd>The data in the database is organized so that all the data elements relating to the same real-world event or object are linked together;</dd><dt style="font-weight: bold;">Time-variant </dt><dd>The changes to the data in the database are tracked and recorded so that reports can be produced showing changes over time;</dd><dt style="font-weight: bold;">Non-volatile </dt><dd>Data in the database is never over-written or deleted - once committed, the data is static, read-only, but retained for future reporting; and</dd><dt><span style="font-weight: bold;">Integrated</span> </dt><dd>The database contains data from most or all of an organization's operational applications, and that this data is made consistent.</dd></dl>Kunalhttp://www.blogger.com/profile/12560005099362618798noreply@blogger.com0