Job Description
AgileEngine is a top-ranking provider of software solutions to Fortune 500, Global 500, and Future 50 companies. Listed on Inc. 5000 among the fastest-growing US companies, we are always open to talented software, UX, and data experts in the Americas, Europe, and Asia.

If you like a challenging environment where you're working with the best and are encouraged to learn and experiment daily, there's no better place - guaranteed! :)

We are looking for Lead Data Software Engineer

What you will do

• Collaborate closely with Data Scientists to understand their data requirements, model development needs, and performance optimization goals;
• Design, build, and maintain scalable data pipelines and infrastructure to support ML model development and deployment;
• Collect, process, and prepare large datasets for analysis, feature engineering, and model training;
• Implement data quality checks, validation, and monitoring to ensure the reliability and accuracy of data used in ML models;
• Optimize data storage, retrieval, and processing performance for ML workloads;
• Develop and maintain ETL (Extract, Transform, Load) processes and workflows;
• Manage data versioning, storage, and access control for ML datasets;
• Collaborate with DevOps and IT teams to ensure smooth deployment and scaling of ML models in production environments;
• Stay up-to-date with emerging technologies, tools, and best practices in data engineering and ML infrastructure.

Must haves

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field;
• Proven experience as a Data Engineer, preferably in a role supporting Data Scientists;
• Strong proficiency in programming languages such as Python, Java, or Scala;
• Proficiency with data storage and processing technologies, including SQL databases, NoSQL databases, and distributed computing frameworks (e.g., Hadoop, Spark);
• Experience with data warehousing solutions and data integration tools;
• Experience with data pipeline and workflow management tools: AWS glue, Airflow, etc;
• Knowledge of ML frameworks (e.g., TensorFlow, PyTorch) and ML model deployment;
• Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and containerization (e.g., Docker, Kubernetes);
• Excellent problem-solving skills and a collaborative mindset;
• Excellent oral and written communication skills with a keen sense of customer service.

Nice to haves

• Experience in ad/marketing environment
• Experience working with Data Lakes
• Experience with Scala
• Experience with Glue/EMR/Redshift/Airflow
• Experience with Terraform.

The benefits of joining us

• Professional growth

Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.

• Competitive compensation

We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.

• A selection of exciting projects

Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.

• Flextime

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office - whatever makes you the happiest and most productive.