This role involves designing and implementing robust data architectures using Databricks, AWS, and Azure platforms. The ideal candidate will have extensive expertise indata technologies, cloud platforms, and data engineering.
Client Details
Innovative American company.
Description
Responsibilities:
Monitor and manage data pipelines to ensure the timely and accurate flow of data
Resolve quality checks alerts to ensure the accuracy, completeness, and consistency of data
Monitor and optimize data pipeline performance to meet and exceed established service level agreements (SLAs)
Collaborate with data engineering, data stewards, data owner teams to implement improvements in data quality processes and data pipeline performance.
Collaborate with IT Ops and SRE for building a robust monitoring pipeline,
Implement proactive measures to identify and resolve data issues automatically.
Maintain comprehensive documentation of data operations processes, monitoring procedures, and issue resolution protocols.
Ensure documentation and operating procedures are up to date to facilitate knowledge transfer and training.
Profile
Hard Skills:
3+ years of expertise in hands-on data operations including data pipeline monitoring, support and engineering.
Proficiency managing robust ETL/ELT pipelines for big real-world datasets that could include messy data.
Proficiency in Data Platforms like Databricks or Snowflake.
Expertise in data modeling, ETL processes, and data warehousing.
Coding abilities in Python and SQL scripting languages.
Excellent design and development with SQL database.
Well understanding of CI/CD technologies and incorporate Terraform and automation of Infrastructure and pipelines.
Well understanding of Databricks and Databricks Access Bundles and incorporate automation and well architected data operations.
Desirable:
Proficiency in AWS and/or Azure.
Knowledge of workflow tools (Databricks, Azure Data Factory, AWS Glue, etc)
Job Offer
54k annual tuition support for master's degrees, diplomas, certifications.
15% of food vouchers: 2,600 in vouchers and the rest in payroll minus taxes
Savings fund 8% with cap of law
20 days Christmas bonus
40 dollars for remote work
Access to online courses (Coursera)
Major family medical expenses insurance
Life insurance
Dental and vision insurance
Vacations of 10 days and 5 additional days off (between Christmas and New Year the office is closed)
Stock purchase program capped at 10% monthly salary
Recuerda que ningún reclutador puede pedirte dinero a cambio de una entrevista o un puesto. Asimismo, evita realizar pagos o compartir información financiera con las empresas.