프로젝트
GitHub에서 보기
Lal4Tech/Data-Engineering-With-AWS
Lal4Tech/Data-Engineering-With-AWS has 30 GitHub stars and 16 forks. GitHot measured 0 stars in 24 hours, 0 in 7 days, and 0 in 15 days. Last checked 2026-11-22 01:47 UTC. Last push 2023-04-12.
측정된 스타 증가
- in 24h
- 0
- in 7 days
- 0
- in 15 days
- 0
- in 1 month
- 기록 수집 중
서로 겹치는 기간의 순증가량이며 일별 합계가 아닙니다. 측정값이 없으면 비워 둡니다. 스타는 관심도를 나타내며 품질을 보장하지 않습니다.
소개
Resources and projects from Udacity Data Engineering with AWS nano degree programme
데이터README.md
OriginalData-Engineering-With-AWS
Resources and projects from Udacity Data Engineering with AWS nano degree programme
Projects
Data Modelling
Data modeling with Apache Cassandra
In this project,
- Apply concepts learned on data modeling with Apache Cassandra and complete an ETL pipeline using Python.
- Model the data by creating tables in Apache Cassandra to run queries.
Cloud Data Warehouses
Data warehousing with AWS Redshift
In this project,
- Apply concepts on data warehouses and AWS to build an ETL pipeline for a database hosted on Redshift.
- To complete the project, need to load data from S3 to staging tables on Redshift and execute SQL statements that create the analytics tables from these staging tables.
Spark and Data Lakes
In this project,
- Use Spark and AWS Glue allow you to process data from multiple sources, categorize the data, and curate it to be queried in the future for multiple purposes.
- Build a data lakehouse solution for sensor data that trains a machine learning model.
Automate Data Pipelines
In this project,
- Using Airflow to create high grade data pipelines that are dynamic and built from reusable tasks, can be monitored, and allow easy backfills.
- Create custom operators to perform tasks such as staging the data, filling the data warehouse, and running checks on the data as the final step.
관련 프로젝트 살펴보기
불러오는 중…