Job Description:

The Senior Lead Data Engineer will report will support portfolio analytics team code development and migration from SAS to Databricks.?

• Minimum of 5-8 year of experience in Databricks workspace, Databricks notebooks, Job cluster

• Hands on experience in performance tuning and optimizing code running in Databricks environment.

• Experience on scheduling jobs in data bricks

• Experience in PySpark and common Python libraries.

• Support SAS to Databricks migration

Additional Information:

Top 3 Skills: Pyspark, Databricks, SAS

Mandatory Skills:

Minimum of 5-8 years' experience in PySpark and Python coding in data bricks environment is REQUIRED Strong working knowledge of Snowflake, Snowpark, specifically to write complex, highly optimized queries across large volumes of data is HIGHLY DESIRED Strong experience with version control systems such GitHub is REQUIRED Experience using Airflow scheduler is preferred Mentor junior analyst and prepare training materials