Project Profile
ChinaNetcom has implemented ERP system and ERP extension systems in production of all group companies, enterprise management involving processes have included in current ERP system, large number of sales information entry make data sources for business analysis and sales management. With growing users' requirements, report functions in ERP and ERP extension systems can not fully fulfill different category users' requirements efficiently.
In report functions, major problem is about coming from different data sources makes report query is difficult, statistics analysis is made by manual calculation, and reports can not direct display by systems. The main reason is data format inconsistent in ERP and extension systems, each module report function is individual and separate, lack of graphic direct display, and ca not support combined statistics report and comprehensive analysis; in user's point of view, main problem is the logic to query formation is not improved, duration is too long for processing report analysis, report display is not direct and employees' work not efficient. The reason is ERP and extension systems do not provide direct use to management level, not support customized report flexibility for report analyzer.
Therefore, in order to take full advantage of information in ERP and extension systems, information sources must be unified, improving system performance for user-friendly, improve analytical reports efficiency, ERP report platform can support management level decision making, increase management efficiency, reduce management cost.
Project Background
Beijing Tao Lung Waldorf Software Co., Ltd. works with well-known Pervasive and MicroStrategy to build complete business intelligence platform for China NetCom. Pervasive's data management helps business intelligence software system to be a rapid and effective platform for standardization of data transmission, also brought better information control capability to greatly improve work efficiency.
China Netcom Group ERP implementation 3rd phase includes: monthly financial reports, assets, purchase, programs inventory, implementation scopes are three-tiers including company groups, provinces, counties, cities. All data sources are from ORACLE ERP system ORACLE9i database library, data target is DB2 database library. In this project, data interface are all database library interface.
Pervasive Application Scenes
In this project, all ETL works is done by Pervasive product development. Tools are Process Designer and Map Designer. Scenes are including 1st is real-time data extraction, 2nd is one-time basis basic data extraction, and 3rd is frequent data updates.
Real-time Data Extraction
Monthly report financial module is using Pervasive real-time data extraction and data production, ETL process in monthly report financial module needs user to trigger formation of monthly financial reports in front end, then real-time extraction of ODS data to re-produce monthly financial report required fact tables.
In this scene, this user had strict requirements on ETL processes effectiveness when generating Monthly Financial Report. Developers used Pervasive ETL process to achieve all business functions, while the processes efficiency fully met user requirements.
- One-time Data Extraction Flow
Assets, purchase, program inventory, data extraction in these three modules is through Pervasive one-time data extraction process flow.
In this scenes, main risk is ODS data extraction speed. In this project, 8 execution threads are executed to extract data, the speed of data extraction will be completely meet the efficiency requirement when basic data is deployed. Each ODS data interface is developed with Pervasive projector designer, through projector designer is able to achieve cross sources data extraction.
In this project, there are 70 ODS data interfaces through 70 projectors designers to divide several projectors into some data extraction process. The numbers of data extraction processes are defined by the numbers of server programs to ensure these data extraction processed executing simultaneously. Data extraction processes in each business module is done by several child processes to be transferred by Pervasive process designer to connect these child processed into one complete data extraction process.
Assets, purchase, program inventory, data extraction in these three modules are required to update date at nights. This feature developed by Pervasive to update data flow.
Task Scheduler is able to scheduling Pervasive programs through windows' work scheduling to complete daily data extraction scheduling work. Pervasive's process designer is able to connect each small business data extraction process into a complete process and also develop data extraction process executions.
Pervasive Application Summary
- Process Integration Design
Pervasive Process Designer can handle multiple logic processes integration. Process Designer has an intuitive drag-down interface for integration process design. With simple symbolic processes, Process Designer's automatic integration work is to align integrated steps into each single one, including simple integration processes, multi steps business management control, massive data loading concurrent handling, even is a complicate integration with many message in queues.
- Highly Efficient Multiple Data Sources Operations
Pervasive Map Designer can highly efficient process multiple data sources operations, Map Designer is a powerful data mapping and converter designer, it provides a visual and attractive user interface and orientation, and increasing ease of use. XML-based definition of integration process capability makes fully re-use possible, it separates mapping objects (like data sources and target sources) to more individual objects to increase largely objects re-use capabilities in production environment.
- Flexible Scheduling Process
Pervasive Integration Engine can define flexible scheduling processes. Integration Engine is the core of integrated product line. Integration Engine can handle complexity of different projects, including the extraction, transform, loading (Data Integration) projects and B2B integration projects (that is, HIPAA, HL7, ACORD, X12 and SOA adapters). In addition, Integration Engine is easy to enrich SDK and embed command-line interface together through an accurate external control. Pervasive engine can be configured to meet any requirement for any integration projects extension.
