Data Engineering | DevOps | AWS Cloud Services
Hi, I'm Shrithik. As a recent graduate, I have proficient skills in AWS cloud services with a key interest in Data Engineering and DevOps. I am eager to join a collaborative team and develop my skills in a professional environment.
This project aims to securely manage, streamline, and perform analysis on the structured and semi-structured YouTube videos data based on the video categories and the trending metrics. Implemented a centralized data ingestion and ETL system to transform raw data from various sources into a structured format for analysis. Developed a scalable data lake architecture, ensuring the system can handle increasing data volumes while building a dashboard for efficient reporting and insights extraction. (AWS S3, AWS Glue, AWS Lambda, AWS Athena)
Developed and implemented an ETL pipeline using Python to extract bitcoin exchange data from CoinCap API and load it into a PostgreSQL data warehouse. Orchestrated project setup locally and on AWS cloud, leveraging Terraform for infrastructure as code, CI/CD for automated testing, and "make" commands for efficient development workflows. The main project goal was to create a dynamic dashboard, providing valuable insights for users. (AWS, Docker, Terraform, Makefile, Github Actions, PostgreSQL)
Developed an application to generate Summaries and Chapter Timestamps for Youtube. Implemented CI/CD for automated testing and Deployment onto AWS Architecture. Utilized Google PALM's natural language processing and Python's powerful backend. (PaLM API, GPT-3.5, AWS, Streamlit)
Developed and deployed a dynamic resume website hosted on AWS S3, offering a user-friendly interface for visitors. The site fetches data from DynamoDB to showcase personalized information. Implemented CI/CD pipeline using GitHub Actions, ensuring automated and efficient testing, as well as seamless deployment updates. Utilized Terraform for infrastructure as code, enabling simplified management and scalability of the website, resulting in an impressive and professional web presence. (AWS S3, Terraform, Github Actions, AWS Dynamo DB)