Lead Data Engineer

Who we are

Apex Systems is a leading Data and Digital Transformation professional services organization focused on providing solutions with real business value. We provide a customer-focused approach to building authentic partnerships with our clients with objective counsel from concept to deployment for a consistent voice through the dynamic IT environment.

What we look for:

Join our talented team of technologists who work with our clients to solve their most challenging software and application problems. Our mission is providing Insights that Inspire. In this role, you will work among engineering teams to develop cutting-edge software solutions.

We are seeking a Lead Data Engineer to work with various clients at our delivery center in Guadalajara, MX. Our mission at Apex Systems is providing Insights that Inspire. As a Lead, you will help achieve that mission by giving our clients consultative guidance and technical expertise

• Take ownership of GCP migration project, including translation of the existing logic and code from legacy on-premises data marts to new pipeline development, implementation, and deployment on Google Cloud Platform.
• Design, implement, and optimize data pipelines and ETL processes on Google Cloud Platform using services such as BigQuery, Dataflow, Dataproc, etc.
• Write efficient SQL/BigQuery/Python code for use in data pipelines and data processing.
• Develop and maintain scalable data infrastructure on GCP, ensuring reliability, performance, and security.
• Drive data quality processes like data profiling, data cleansing, etc.
• Perform QA and UAT processes to foster an agile development cycle.
• Create documentation on table design, mapping out steps and underlying logic within data marts to facilitate data adoption with minimum guidance from the Enterprise Analytics management.
• Develop best practices and approaches to support continuous process automation for data ingestion and data pipelines.
• Use innovative problem solving and critical thinking approaches to troubleshoot challenging data obstacles.
• Troubleshoot and debug issues related to data pipelines, ensuring smooth operation and minimal downtime.
• Implement best practices for data governance, data quality, and metadata management.
• Collaborate with data scientists and analysts to understand data requirements and implement solutions that meet their needs.
• Provide technical guidance to the data engineering team, ensuring best practices and standards are followed.
• Additional duties as assigned.