Carlos Pacheco

Senior Data Engineer | Data Architect | Cloud Migration Specialist

Charleston, South Carolina Metropolitan Area LinkedIn GitHub

Professional Experience

HealthPartners

Senior Data Engineer

February 2025 - Present

  • Leading architecture and implementation of healthcare data engineering solutions
  • Designing scalable data pipelines for clinical and operational analytics
  • Implementing data governance frameworks to ensure compliance with healthcare regulations

RunPod

Senior Data Engineer

October 2024 - February 2025

  • Built robust ETL pipelines using Dagster and DBT to sync data into Snowflake
  • Improved performance and reliability of ETL processes, reducing processing time by 30%
  • Enhanced data integration from diverse sources, optimizing data flow efficiency
  • Implemented automated testing frameworks to ensure data quality and integrity

Booz Allen Hamilton

Lead Engineer

May 2024 - October 2024

  • Spearheaded a major cloud data migration project, leading a technical team of 5 engineers
  • Led customer-facing meetings to gather requirements and ensure project success
  • Designed and implemented cloud-native data architecture solutions
  • Managed project timelines and resource allocation using Agile methodologies

Booz Allen Hamilton

Databricks Platform Architect

November 2023 - May 2024

  • Devised and implemented Databricks platform optimizations, reducing infrastructure costs by 25%
  • Established and enforced data governance policies across enterprise data platform
  • Assessed and incorporated new technologies to augment platform functionality and performance
  • Directed technical development of Databricks solutions aligned with strategic business objectives
  • Created scalable data pipelines using PySpark to enhance data processing capabilities

ANDMORE

Data Engineer

June 2021 - April 2023

  • Led data pipeline design and development using Databricks and Azure Data Factory
  • Ensured data quality while loading data into Azure Data Lake and Snowflake
  • Enhanced ETL workflow scalability, handling 200% increase in data volume
  • Built custom data connectors for seamless ingestion from multiple sources
  • Orchestrated data processing with Apache Airflow, developing custom DAGs

Royal Caribbean Group

Technology Analyst

May 2020 - June 2021

  • Supported revenue management systems and business intelligence reports
  • Improved PL/SQL code to adapt to changing business patterns, reducing errors by 30%
  • Presented technical methods and impacts to stakeholders in clear, accessible language
  • Identified and prioritized technology initiatives aligned with strategic goals

Royal Caribbean Group

Analyst, Data Visualization and BI

March 2019 - May 2020

  • Designed reporting and analytics solutions with focus on data visualizations
  • Consolidated data from multiple large datasets to create reports and dashboards
  • Developed interactive visualizations supporting business decision-making
  • Identified KPIs and metrics to track visualization effectiveness

Skills

Data Engineering

  • ETL/ELT Pipeline Design
  • Data Modeling
  • Data Warehousing
  • Data Quality Management
  • Data Governance

Cloud Platforms

  • Azure Synapse
  • Azure Data Factory
  • Azure Data Lake
  • Databricks Lakehouse Platform

Programming

  • Python
  • PySpark
  • SQL
  • PL/SQL
  • DBT

Orchestration Tools

  • Apache Airflow
  • Dagster
  • Azure Data Factory

Data Storage

  • Snowflake
  • Azure Data Lake
  • Delta Lake

Additional Skills

  • Power BI
  • Agile
  • JIRA
  • Data Security
  • Performance Optimization

Education

Bachelor of Science in Chemistry

Instec

Artificial Intelligence Boot Camp

July 2023 - September 2023

UCF College of Health Professions and Sciences

Back to Home