Available for opportunities

Mohamed.Magdy

Big Data Engineer | Big Data Architecture

"Transforming large-scale raw data into reliable, business-ready insights."

About

Data Engineer / Pipeline Architect

Data Engineer specialized in designing and building scalable ETL pipelines and distributed data processing systems using Python, SQL, and Apache Spark. Experienced in data warehouse design, workflow orchestration with Apache Airflow, and containerized deployments using Docker.

Experience

Freelance Software Engineer

Nov 2022 – Dec 2025
20+
Projects Delivered
100%
Client Satisfaction
5K+
Monthly Users
70%
Task Automation

Delivered 20+ end-to-end data and software projects with 100% client satisfaction, serving 5K+ monthly users while reducing repetitive tasks by 70% through automation.

Skills

Technologies & Tools

Languages

Python SQL JavaScript

Big Data

Spark PySpark Hadoop Data Modeling

Databases

SQL Server BigQuery MongoDB

Orchestration

dbt Airflow n8n

APIs

Odoo OpenAI / LLM Telegram WhatsApp

DevOps

Docker Nginx Git

Projects

Data Pipeline Portfolio

100K+
Records

ETL Sales Data Pipeline

Automated ETL pipeline processing 100K+ sales records with Airflow scheduling and Docker Compose deployment.

Python Airflow Docker SQL Server
99% data accuracy
Airflow scheduling
Docker Compose
Automated alerts
200K+
Records

ETL YouTube Data Pipeline

Scalable pipeline processing 200K+ records using Spark, achieving 25% query performance improvement.

PySpark Spark SQL SQL Server Docker
25% query improvement
Spark processing
SQL Server in Docker
Incremental loads

Education

Academic Background

Feb – Jun 2026

Digilians Big Data Track

Digital Egypt Pioneers Initiative (DEPI)

2025

Postgraduate Diploma in Computer Science

Cairo University

Specialization in Data Engineering

2023

Bachelor of Business Administration

Ain Shams University

Certifications

Professional Credentials

Huawei HCCDA Big Data & Tech Essentials
NTI Huawei Big Data Associate
DataCamp Associate Data Engineer in SQL
ITI & Nvidia LLM / Prompt Engineering