We are in search of a Lead Data Software Engineer to join our organization. This role blends direct technical contribution with leadership duties, giving you the ability to shape data architecture while steering delivery on high-stakes projects. You will work hand-in-hand with stakeholders and engineering teams to keep solutions dependable and scalable as demands increase. If you value merging substantial technical involvement with accountability for delivery outcomes, this opportunity could be well suited to you.
Responsibilities
-
Build and maintain the codebase driving ETL and ELT pipelines, in addition to large batch, micro-batch, and streaming systems
-
Set up the infrastructure required to extract, transform, and load data effectively from a wide range of sources using ADF, Spark, Kafka, or similar technologies
-
Identify, plan, and deliver internal process improvements, including automating manual work, optimizing data delivery, and adjusting infrastructure to boost scalability
-
Architect and deploy data services solutions using technologies such as Spring Boot, ReactJS, NoSQL, and other related UI and API tools
-
Maintain governance across delivery management and production workflows, consistent with the chosen delivery model
-
Act as the central point of contact for delivery matters with senior leadership and stakeholders, covering escalations, upsells, and ramp-downs
-
Set technical direction throughout delivery, ensuring the architecture stays strong and future-proof while implementation aligns with expected quality standards
-
Prepare user stories and their associated acceptance criteria within an agile/scrum framework
-
Coordinate contributions across various disciplines and stakeholders to keep delivery on pace
-
Confirm project delivery follows customer processes and methodologies, applying solid knowledge of different delivery models with an agile-driven approach
-
Formulate a continuous delivery risk management framework that supports proactive decision-making across the delivery lifecycle
-
Track and drive improvements in delivery productivity over time
-
Serve as a technical resource for Data Engineers, supporting the quality and timeliness of their deliverables
-
Manage production support and deployment responsibilities
Requirements
-
A minimum of 5 years of experience in a comparable role
-
At least one year of experience leading and managing teams
-
Solid command of core Python for data engineering work
-
Proficient in SQL for querying and processing data
-
Practical experience with Apache Spark for large-scale data processing
-
Familiarity with Anthropic Claude Code
-
Experience working with Databricks for data engineering and analytics purposes
-
Excellent English proficiency (B2 level or higher)
Nice to have
-
Experience with Apache Kafka for managing streaming data flows
-
Working knowledge of Java
-
Practical experience with PySpark
-
Familiarity with Scala
-
Experience with Spark Streaming
We offer
-
International projects with top brands
-
Work with global teams of highly skilled, diverse peers
-
Healthcare benefits
-
Employee financial programs
-
Paid time off and sick leave
-
Upskilling, reskilling and certification courses
-
Unlimited access to the LinkedIn Learning library and 22,000+ courses
-
Global career opportunities
-
Volunteer and community involvement opportunities
-
EPAM Employee Groups
-
Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn
