Monday, January 30, 2017

All about Data

We have heard a lot about data technologies and tools. There is data modelling, data quality, metadata management, data governance, data stewardship, data lineage, data profiling and so on. Let's figure out just HOW does all these concepts fit together. So basically it means this -  We need to understand the data we have , design and arrange it in a logical manner, centralize the pool of data and then map those data to its business definition by enforcing a standardization and governance process. When we have those in place, we can further understand the quality of the data by setting up the business rules to check the data correctness and  subsequently trace it back to the original source. This process is a continuous journey and the further we go, the better our data quality and governance are, and yes corporate jargon call this as Data Strategy.So when we have all these concepts and understanding in place aka the Data Strategy, we can choose the solution from one or a combination of tools from vendors like SAP Power Designer, Information Steward, Informatica, Erwin , ER/Studio, Collibra that meet our budget and IT environment to implement it.