Data Management Data migration is a critical and often underestimated activity in the overall system building activities. The data migration activities require the steps to data cleansing, profiling, mapping and conversion before moving the data to the target systems. Tools and process selection is complex and must be carefully analyzed. Considering users needs during this process will result in improved data quality.The economic impact of a successful and effective data migration project is far-reaching. Simply put, data migration is the process of moving stored data from one configuration or assignment to another. It primarily involves the rearrangement of database entities such as physical and security data, schemas, rules, views, triggers and stored procedures. Data migration is a vital component of application integration or reengineering projects, and is essential in the effective management of multiple data sources. The following activities are always associated around moving data: Data cleansing Data Migration Data Profiling and Mapping Data Cleansing Over the last several years leading industry analysts and data quality experts have opined that the success or failure of an e-business systems hinges in large part on the quality of an organizations information. As more and more organizations turn to these IT-driven initiatives to increase revenue growth, productivity and customer satisfaction. Redundant data (identified during data analysis or generated as a result of the migration)must be eliminated and the converted data must be validated. The process must be performed for every data model modification, transformation rule, and script modification. Users should be involved in the elimination process. Data Migration Complications arise when we attempt to bring together the information currently maintained by the heterogeneous system(s) and transform it to fit into the new system. We refer to the building of this bridge between the old and new systems as data migration. Data migration is a common component most systems development efforts. Data migration is an important phase of this whole effort. There are several approaches one can take for data migration project. Each approach has distinct advantages with respective data migration effort. It is always advisable to prepare the approach when adequate information for the source data, target data and complexity in data migration requirements is known. Data Profiling and Mapping IT organizations can begin their data analysis by implementing a two-step process: data profiling and mapping. Data profiling involves studying the source data thoroughly to understand its content, structure, quality and integrity. Once the data has been profiled, an accurate set of mapping specifications can be developed based on this profile, a process called data mapping. The combination of data profiling and mapping comprises the essential first step in any successful data migration project and should be completed prior to attempting to extract, scrub, transform and load the data into the target database. Conclusion Data migration is a necessary evil, but not an impossible one to conquer. The key is to prepare for it very early on, and continue to monitor data migration throughout the life of the project. Project timelines tend to become more rigid as time passes, so it makes sense to meet migration head on. A devoted team with a clearly defined project plan from the inception of the project is the formula to success.Neither Programming nor Transformation Engine technology can be a universal ‘best-fit’ solution for all data migration efforts. In some cases custom code generators may be prove effective enough for extracting and collecting metadata from multiple, disparate sources. While in assignments involving complex record matching and integration or requiring a "data hub" for data pending transformation, etc., the use of a transformation engine is recommended.
The Off-Shore Advantage Some benefits for outsourcing projects include: · Time to market advantage: Fixed price model ensures timely delivery and project · Resource Scalability Advantage: Capability to handle projects in excess of own development capability · Cost Advantage: Being able to deliver development projects at a lower and predictable cost · Features Advantage: Through reduced development cost and increased scalability you can include more features in the system · Growth Advantage: Since project management has been outsourced you can possibly spend more time in the market for business development and managing growth · Know-how Advantage: Working with experts who have done similar projects and bring several years of collective learning. · Round-the-clock Advantage: Since India is 12 hours ahead of the US (PST), work is ready when the US staff wakes up. Some benefits of engaging your outsourcing and project needs include the following: · Project definition for outsourcing · Complete program management · Single contract for all projects · Fixed priced model · Assured quality and timeliness · Integrated methodology across all platforms · We assume overall project responsibility · Ongoing integration and support onsite through the same team Analysts, programmers are difficult to recruit and retain the US & Europe but are available through stringent recruiting standards in India. Assured level of resource availability: The partners assure you of a certain level of dedicated resources. Infrastructure availability: High standards in development platforms, test-beds and configuration management tools. T1 Internet access. Common set of tools on all development machines to name a few.>
.
Cyberservices 2003