Hello, I'm Carlos Pacheco

Senior Data Engineer specialized in building scalable data pipelines and architecture

Carlos Pacheco

About Me

With over 8 years of experience in data engineering, I specialize in designing, implementing, and optimizing data architectures and pipelines for large-scale applications.

My expertise lies in developing robust ETL/ELT processes, implementing real-time data streaming solutions, and building data warehouses that enable organizations to make data-driven decisions.

I'm passionate about big data technologies, cloud computing, and applying best practices to create scalable and maintainable data infrastructure. My goal is to transform complex data challenges into efficient, reliable solutions.

Download Resume
Carlos Pacheco

Skills & Expertise

Data Engineering

  • Apache Spark
  • Hadoop Ecosystem
  • Airflow
  • Kafka
  • ETL/ELT Design
  • Data Warehousing

Programming Languages

  • Python
  • SQL
  • Scala
  • Java
  • Shell Scripting

Cloud & Big Data

  • AWS (S3, EMR, Redshift)
  • Google Cloud Platform
  • Azure Data Services
  • Snowflake
  • Databricks

Tools & Technologies

  • Docker
  • Kubernetes
  • Git
  • CI/CD Pipelines
  • Terraform

Work Experience

February 2025 - Present

Senior Data Engineer

HealthPartners

Leading architecture and implementation of healthcare data engineering solutions. Designing scalable data pipelines for clinical and operational analytics. Implementing data governance frameworks to ensure compliance with healthcare regulations.

October 2024 - February 2025

Senior Data Engineer

RunPod

Built robust ETL pipelines using Dagster and DBT to sync data into Snowflake. Improved performance and reliability of ETL processes, reducing processing time by 30%. Enhanced data integration from diverse sources and implemented automated testing frameworks.

May 2024 - October 2024

Lead Engineer

Booz Allen Hamilton

Spearheaded a major cloud data migration project, leading a technical team of 5 engineers. Led customer-facing meetings to gather requirements and designed cloud-native data architecture solutions. Managed project timelines using Agile methodologies.

November 2023 - May 2024

Databricks Platform Architect

Booz Allen Hamilton

Devised and implemented Databricks platform optimizations, reducing infrastructure costs by 25%. Established data governance policies and created scalable data pipelines using PySpark to enhance data processing capabilities.

June 2021 - April 2023

Data Engineer

ANDMORE

Led data pipeline design and development using Databricks and Azure Data Factory. Ensured data quality while loading data into Azure Data Lake and Snowflake. Enhanced ETL workflow scalability, handling 200% increase in data volume.

May 2020 - June 2021

Technology Analyst

Royal Caribbean Group

Supported revenue management systems and business intelligence reports. Improved PL/SQL code to adapt to changing business patterns, reducing errors by 30%. Presented technical methods and impacts to stakeholders.

March 2019 - May 2020

Analyst, Data Visualization and BI

Royal Caribbean Group

Designed reporting and analytics solutions with focus on data visualizations. Consolidated data from multiple large datasets to create reports and dashboards. Developed interactive visualizations supporting business decision-making.

Get In Touch

Have a project in mind or want to discuss opportunities? I'm interested in working on challenging data engineering projects. Feel free to reach out through the contact form below.

  • Location

    Charleston, SC