Skip to content
View tomcrojo's full-sized avatar
🎌
🎌
7 followers · 5 following

Block or report tomcrojo

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
tomcrojo/README.md

Tomas Campoy Rojo

Data Engineer building production batch, lakehouse, and streaming pipelines with Python, SQL, dbt, Spark, Airflow, AWS, and Azure.

AWS Certified Data Engineer - Associate (February 2026) and Azure Databricks Platform Architect.

Open to Data Engineer roles in Madrid or remote.

Selected Projects

AWS GDPR-Compliant Healthcare Data Pipeline

AWS-native pipeline designed for 10M+ healthcare records per day with GDPR Article 17 compliance.

  • Impact: ~65s erasure SLA, 8,500+ records/s ETL throughput
  • Stack: AWS Glue, Athena, Redshift Serverless, Lambda, KMS, CloudFormation

Azure Medallion Pipeline

Azure lakehouse pipeline implementing Bronze, Silver, and Gold layers with infrastructure provisioned through Terraform.

  • Scope: 7M+ orders, 200K customers, 500 products
  • Stack: Terraform, Azure Data Factory, Databricks, PySpark, Delta Lake

Student Data Pipeline

Production ETL pipeline consolidating academic data from multiple sources into analytics-ready models.

  • Impact: runtime reduced from 15 min to ~5 min, production errors down 90%
  • Stack: dbt, Airflow, DuckDB, PostgreSQL, Docker, GitHub Actions

Streaming Orders Pipeline

Real-time order processing pipeline built around event-driven ingestion and streaming quality checks.

  • Stack: Kafka, Spark Structured Streaming, Iceberg, MinIO, Streamlit
  • Focus: exactly-once semantics, watermarking, windowed aggregations, anomaly detection

Focus

  • Batch pipelines and ELT modeling
  • Lakehouse and medallion architectures
  • Data quality, reliability, and operability
  • Cloud data engineering on AWS and Azure

Contact

Pinned Loading

  1. tfm-licitaciones tfm-licitaciones Public

    DataOps pipeline reproducible: integra, normaliza, enlaza y clasifica licitaciones públicas tecnológicas (TED + OpenPLACSP). TFM UCM.

    Python

  2. azure-medallion-pipeline azure-medallion-pipeline Public

    Azure medallion pipeline with Terraform, ADF, Databricks, and PySpark

    Python 1

  3. ecommerce-dbt-snowflake ecommerce-dbt-snowflake Public

    dbt and Snowflake ELT pipeline with dimensional modeling and CI

    Python

  4. streaming-orders-pipeline streaming-orders-pipeline Public

    Real-time order processing pipeline with Kafka, Spark Streaming, and Iceberg

    Python