Skip to content
프로젝트

Lal4Tech/Data-Engineering-With-AWS

GitHub에서 보기

Lal4Tech/Data-Engineering-With-AWS has 30 GitHub stars and 16 forks. GitHot measured 0 stars in 24 hours, 0 in 7 days, and 0 in 15 days. Last checked 2026-11-22 01:47 UTC. Last push 2023-04-12.

이 수치를 측정하는 방법

측정된 스타 증가

in 24h
0
in 7 days
0
in 15 days
0
in 1 month
기록 수집 중

서로 겹치는 기간의 순증가량이며 일별 합계가 아닙니다. 측정값이 없으면 비워 둡니다. 스타는 관심도를 나타내며 품질을 보장하지 않습니다.

소개

Resources and projects from Udacity Data Engineering with AWS nano degree programme

데이터

README.md

Original

Data-Engineering-With-AWS

Resources and projects from Udacity Data Engineering with AWS nano degree programme

Projects

Data Modelling

Data modeling with Apache Cassandra

In this project,

  • Apply concepts learned on data modeling with Apache Cassandra and complete an ETL pipeline using Python.
  • Model the data by creating tables in Apache Cassandra to run queries.

Cloud Data Warehouses

Data warehousing with AWS Redshift

In this project,

  • Apply concepts on data warehouses and AWS to build an ETL pipeline for a database hosted on Redshift.
  • To complete the project, need to load data from S3 to staging tables on Redshift and execute SQL statements that create the analytics tables from these staging tables.

Spark and Data Lakes

STEDI Human Balance Analytics

In this project,

  • Use Spark and AWS Glue allow you to process data from multiple sources, categorize the data, and curate it to be queried in the future for multiple purposes.
  • Build a data lakehouse solution for sensor data that trains a machine learning model.

Automate Data Pipelines

Data Pipelines with Airflow

In this project,

  • Using Airflow to create high grade data pipelines that are dynamic and built from reusable tasks, can be monitored, and allow easy backfills.
  • Create custom operators to perform tasks such as staging the data, filling the data warehouse, and running checks on the data as the final step.

관련 프로젝트 살펴보기

불러오는 중…