Big Data

Consulting and Scoping

• Detailed revision of current BI system
• Documentation of business requirements
• Suggestion of appropriate architecture design and technology stack

Architecture and Design

• Designing of data structure for scalability on demand
• Development and deployment of ready-to-use platform (on premise or in cloud)

Data Ingestion

• Development and customization of flexible data ingestion framework based on the data pipeline architecture
• Execution of well-designed process of data ingestion – from prioritizing data sources to routing data items to the appropriate destination
• Enablement of multiple source ingestion, continuous query, and improved ingestion speed

Data Cleansing

• Apply business rules to ensure data integrity
• Automate cleansing
• Filter data that does not follow business rules and alert data owners

Data Processing

• Collection, transmission, transformation, decoding, storing, and retrieval of data
• Validation of data for consistency and accuracy
• Application of streaming or in-memory techniques for data processing

Data Analysis and Reporting

• Standardization, matching and merging of data
• Development of automated reporting system
• Configuration of data science feature for pattern detection and predictive model development

Migration to Big Data

• Assessment of technical readiness of BI system for migration to Big Data platform;
• Analysis of existing Data Warehouse infrastructure and ETLs
• Development of migration strategy based on business goals
• Migration of legacy BI system to new Big Data platform on premise or in cloud