Job#: 3033263

Job Description:

Apex Systems Mexico is a leading technology consulting and professional services organization, delivering high‑impact solutions across data, cloud, and digital platforms. We partner with organizations to solve complex challenges through strong engineering, modern architectures, and a client‑focused delivery model.

We are seeking a Senior Data Engineer (Databricks) to join Apex Systems’ Solutions Delivery Organization. This role focuses on designing, building, and operationalizing scalable, high‑performance data pipelines that support analytics, reporting, and data‑driven decision‑making.

The role is hands‑on and delivery‑oriented, working closely with cross‑functional stakeholders, architects, and other engineers to deliver production‑ready solutions. The ideal candidate combines strong Databricks and Spark expertise with consulting skills, ownership mindset, and a focus on quality and continuous improvement.

Databricks & Data Pipeline Development

• Design and develop scalable data pipelines using Databricks notebooks, clusters, workflows, and jobs.
• Build and manage ETL / ELT pipelines using Delta Lake and Delta Live Tables (DLT).
• Ingest, transform, validate, and publish high‑quality data products following modern data architecture standards.
• Work with structured and semi‑structured data formats including CSV, TSV, XML, and JSON.

Data Architecture & Optimization

• Implement and optimize Delta Lake for ACID‑compliant data processing, schema evolution, and time travel.
• Apply medallion and lakehouse architecture patterns.
• Monitor, tune, and optimize workloads using Databricks performance tools and metrics.

Cloud, Governance & DevOps

• Leverage cloud storage platforms such as Amazon S3, Azure Blob Storage, and Databricks Volumes.
• Implement Unity Catalog for data governance, lineage, and access controls.
• Embed DevOps and CI/CD practices using Git‑based workflows, Databricks Asset Bundles (DABs), and CI/CD pipelines.

Collaboration & Consulting

• Collaborate with cross‑functional teams to deliver reliable, production‑ready solutions.
• Communicate effectively with technical and non‑technical stakeholders.
• Mentor junior engineers through technical guidance and knowledge sharing.
• Take ownership of deliverables, timelines, and engagement success.
• Proactively identify improvement opportunities and contribute to solution design.

• Bachelor’s degree in Computer Science, Information Systems, or equivalent professional experience.
• 5+ years of data engineering experience, including 3+ years of hands‑on Databricks experience.
• Strong expertise with Apache Spark and Databricks.
• Advanced proficiency in PySpark, SQL, and/or Scala.
• Hands‑on experience with Delta Lake and Delta Live Tables (DLT).
• Experience designing and implementing cloud‑based ETL / ELT pipelines (AWS preferred; Azure acceptable).
• Strong experience handling structured and semi‑structured data.
• Familiarity with Databricks Jobs, Workflows, and Unity Catalog.
• Experience integrating data from APIs, cloud storage, and enterprise systems.
• Solid understanding of modern data architectures (lakehouse, medallion).
• Experience with Git‑based version control and CI/CD practices.
• Strong problem‑solving, communication, and client‑facing skills.
• Power BI knowledge is required; hands‑on dashboard/report development is a plus.

• Experience with Generative AI, Agentic AI, or MLflow.
• Advanced usage of Delta Live Tables for declarative pipeline development.
• Databricks and/or cloud provider certifications.
• Familiarity with data governance tools such as Unity Catalog, Purview, or Collibra.
• Experience with REST APIs, streaming data, or real‑time architectures.

Core Technologies

• Databricks, Apache Spark
• Delta Lake, Delta Live Tables (DLT)
• PySpark, SQL, Scala

Cloud & Storage

• AWS (S3 preferred)
• Azure Blob Storage
• Databricks Volumes

Governance & DevOps

• Unity Catalog
• Git, CI/CD, Databricks Asset Bundles

Analytics

• Power BI

Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including Great Place to Work® and Great Place for Women to Work® in Mexico.

VEVRAA Federal Contractor.
We request Priority Protected Veteran & Disabled Referrals for all of our locations within the state.