We are seeking a Lead Data Software Engineer to join our organization. This position combines hands-on technical contribution with leadership accountability, providing the chance to shape data architecture while guiding delivery on mission-critical projects. You will collaborate closely with stakeholders and engineering teams to ensure solutions remain robust and scalable as needs grow. If you thrive on combining meaningful technical work with responsibility for delivery success, this role may be an excellent fit for you.
Responsibilities
-
Construct and uphold the codebase behind ETL and ELT pipelines, along with large batch, micro-batch, and streaming systems
-
Build the infrastructure needed to extract, transform, and load data efficiently from diverse sources using ADF, Spark, Kafka, or related technologies
-
Pinpoint, plan, and implement internal process improvements, including automating manual tasks, refining data delivery, and adapting infrastructure to enhance scalability
-
Design and launch data services solutions using technologies such as Spring Boot, ReactJS, NoSQL, and other associated UI and API tools
-
Sustain governance over delivery management and production processes, in keeping with the selected delivery model
-
Serve as the principal contact for delivery-related issues with senior leadership and stakeholders, including escalations, upsells, and ramp-downs
-
Guide technical direction across the delivery process, ensuring the architecture remains solid and forward-looking while implementation satisfies quality expectations
-
Compose user stories together with their associated acceptance criteria within an agile/scrum framework
-
Align contributions across multiple disciplines and stakeholders to maintain delivery momentum
-
Verify that project delivery follows customer processes and methodologies, drawing on strong familiarity with various delivery models and an agile-oriented mindset
-
Create a continuous delivery risk management framework that supports proactive decision-making throughout the delivery lifecycle
-
Observe and improve delivery productivity as time progresses
-
Function as a technical resource for Data Engineers, helping ensure their deliverables meet quality and timeliness expectations
-
Take responsibility for production support and deployment activities
Requirements
-
At least 5 years of experience in a similar role
-
A minimum of one year of experience leading and managing teams
-
Strong command of core Python for data engineering tasks
-
Skilled in SQL for data querying and processing
-
Hands-on experience with Apache Spark for processing data at scale
-
Familiarity with Anthropic Claude Code
-
Experience with Databricks applied to data engineering and analytics work
-
Excellent English proficiency (B2 level or higher)
Nice to have
-
Experience with Apache Kafka for handling streaming data flows
-
Working familiarity with Java
-
Hands-on experience with PySpark
-
Exposure to Scala
-
Experience with Spark Streaming
We offer
-
International projects with top brands
-
Work with global teams of highly skilled, diverse peers
-
Healthcare benefits
-
Employee financial programs
-
Paid time off and sick leave
-
Upskilling, reskilling and certification courses
-
Unlimited access to the LinkedIn Learning library and 22,000+ courses
-
Global career opportunities
-
Volunteer and community involvement opportunities
-
EPAM Employee Groups
-
Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn
