O uso da ferramenta pentaho data integration na migração de dados para implantação do SIGAD/UNICAMP

In 2015, in the deployment process of the new system for management of process/dossier produced by the University, the Document Archive Management System (SIGAD/Unicamp), it was necessary to migrate data from the old Protocol System, in use since 1993. For this purpose, a project was prepared, using Pentaho Data Integration, ETL (Extract Transform Load) open source tool for data extraction, transformation and loading. Due to the large amount of data from the legacy system, 71 transformations were developed for gradual and partial data migration. After transformation modeling and performing various tests, the migration execution of about 18 million records took a little more than 3 days to take place. The results obtained were: legacy system's data recovery in the current management system of process/dossier; work continuity in the new system without interruption or need of having two systems for control; migration of approximately 780,000 data from process/dossier, of 5 million data from process/dossier proceeding data and 11 million records of process/dossier occurrence history; zero cost for tool acquisition with the use of Community version; total deactivation of the legacy system, which used the environment with proprietary tools. Until now, no problem was found in the migrated data. All departments, units and authorities using the current Document Archive Management System, SIGAD/Unicamp, were benefited with this work execution, besides of 344 protocol and archive units, involving approximately 1,600 enrolled agents for document management.