The objective of this proof of concept project is to evaluate the feasibility of converting a traditional ETL architecture for data warehouse load into a hybrid approach with bigdata integration.
Refer the following post for architectural details.
Proof of Concept - Project Plan
The POC project has a timeline of 4 weeks.
- Define Business goals and corresponding use cases.
- Setup and Configuration.
- Architecture and Design.
- Development.
- Evaluation and recommendations.
System Hardware Architecture
Minimal hardware investment planned for the POC project. Cluster configured with 1 master nodes and 3 slave nodes.
System Software Architecture
Application Use Cases
Application use cases include the following.
- Data ingestion from OLTP to HDFS using Sqoop.
- Load Facts using mapreduce jobs.
- Create Aggregates using Hive QLs.
- Export processed Aggregates from from HDFS to DW using Sqoop.
Performance Use Cases
This comment has been removed by the author.
ReplyDeletehttps://saglamproxy.com
ReplyDeletemetin2 proxy
proxy satın al
knight online proxy
mobil proxy satın al
C54XJ