We are looking for a Senior Data Software Engineer to join our team and collaborate directly with our client on building robust data solutions. In this role, you will architect and maintain code for ETL/ELT pipelines, large-scale batch and streaming systems, while providing technical leadership and ensuring high-quality delivery throughout the project lifecycle.
Responsibilities
-
Architect and maintain the code base for ETL and ELT pipelines, large batch/micro batch processing and streaming systems
-
Build out the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using ADF, Spark, Kafka or similar technologies
-
Identify, design and implement internal process improvements, including automating manual processes, optimizing data delivery and re-designing infrastructure for greater scalability
-
Design and implement innovative data services solutions using Spring Boot, ReactJS, NoSQL or other UI and API related technologies
-
Assure governance of processes in delivery management and production as per selected delivery model
-
Act as a single point of responsibility over any delivery-related matters for top management and stakeholders, including escalations, upsells and ramp-downs
-
Provide technical leadership regarding the delivery, ensuring a sound and future-proof architecture is planned and the implementation meets the technical quality standards
-
Write stories and associated acceptance criteria for agile/scrum workflow
-
Coordinate between multiple disciplines and stakeholders
-
Ensure that projects are delivered in line with client processes and methodologies, with focus on agile approaches
-
Establish a strategy of continuous delivery risk management that enables proactive decisions and actions throughout the delivery life cycle
-
Measure and improve delivery productivity, serve as a consultant to Data Engineers and perform production support and deployment activities
Requirements
-
3+ years of experience in SQL, Spark and Scala
-
Expertise in Databricks
-
Background in designing and implementing ETL/ELT pipelines and large batch/micro batch processing systems
-
Familiarity with data services solutions using Spring Boot, ReactJS and NoSQL or other UI and API related technologies
-
Understanding of agile/scrum workflow and different delivery models
-
Capability to provide technical leadership and act as a consultant to Data Engineers
-
English proficiency at B2 level or higher for direct communication with the client
Nice to have
-
Skills in Spark Streaming and Kafka
-
Familiarity with Azure
We offer
-
International projects with top brands
-
Work with global teams of highly skilled, diverse peers
-
Healthcare benefits
-
Employee financial programs
-
Paid time off and sick leave
-
Upskilling, reskilling and certification courses
-
Unlimited access to the LinkedIn Learning library and 22,000+ courses
-
Global career opportunities
-
Volunteer and community involvement opportunities
-
EPAM Employee Groups
-
Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn
