Responsabilidades:

As part of the Data Engineering team, you will be responsible for design, development and operations of large-scale data systems operating at petabytes scale. You will be focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure. You will interact with the engineers, product managers, BI developers and architects to provide scalable robust technical solutions.

Requisitos y competencias:

• 3 years of BIG DATA development experience.
• Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development.
• Experience in agile models
• Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
• Experience with Java, Python and/or Scala to write data pipelines and data processing layers
• Experience in Airflow & Github.
• Advanced English
• Experience in writing map-reduce jobs.
• Demonstrates expertise in writing complex, highly-optimized queries across large data sets in HIVE & Spark.
• Proven, working expertise with Big Data Technologies Spark, Hive, Kafka, BigQuery SQL, HBase.
• Highly Proficient in SQL.
• Experience with Cloud Technologies ( GCP, Azure or AWS)
• Experience with relational model, memory data stores desirable ( Oracle, Cassandra, Druid)
• Provides and supports the implementation and operations of the data pipelines and analytical solutions
• Performance tuning experience of systems working with large data sets
• Experience in REST API data service – Data Consumption
• Retail experience is a huge plus.