Explore chapters and articles related to this topic
Big Data
Published in James William Martin, Operational Excellence, 2021
A business process from a data perspective is an aggregation of metadata from several sources that build work products such as a customer order profile. How an organization's systems use metadata is important for information governance. Data mapping or data lineage traces the sources of metadata and how it flows through various IT applications to create work products, such as an order or invoice. Data lineage shows whether metadata came from a trusted source. It is also important if there are quality issues or if the business rules need to be modified. Software tools are used to crawl though IT applications and trace the end-to-end flow of metadata. Visualization of metadata lineage is important to see high-volume transaction flows to focus process improvement efforts, including the evaluation of metadata performance against business rules. In summary, because of the number of applications and platforms used by organizations, process improvement professionals need to understand metadata quality, lineage, and governance to work effectively with business data stewards, business stakeholders, and others to improve process quality and efficiency.
Schema on read modeling approach as a basis of big data analytics integration in EIS
Published in Enterprise Information Systems, 2018
Slađana Janković, Snežana Mladenović, Dušan Mladenović, Slavko Vesković, Draženko Glavić
Transformation as an operation can vary, ranging from an extremely simple operation to an inexecutable operation, and it may require the use of additional data collections. In the simplest case, it consists of the simple mapping of source fields to target fields, but most frequently it also includes operations such as aggregation, normalization and calculation. Some ETL tools, such as Altova MapForce, include a revolutionary interactive debugger to assist with the data mapping design.