Senior Data Software Engineer (Colombia)

EPAM is a leading general provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are looking for a Senior Data Software Engineer to join our team and collaborate directly with our client on building robust data solutions. In this role, you will architect and maintain code for ETL/ELT pipelines, large-scale batch and streaming systems, while providing technical leadership and ensuring high-quality delivery throughout the project lifecycle. Responsibilities Architect and maintain the code base for ETL and ELT pipelines, large batch/micro batch processing and streaming systems Build out the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using ADF, Spark, Kafka or similar technologies Identify, design and implement internal process improvements, including automating manual processes, optimizing data delivery and re-designing infrastructure for greater scalability Design and implement innovative data services solutions using Spring Boot, ReactJS, NoSQL or other UI and API related technologies Assure governance of processes in delivery management and production as per selected delivery model Act as a single point of responsibility over any delivery-related matters for top management and stakeholders, including escalations, upsells and ramp-downs Provide technical leadership regarding the delivery, ensuring a sound and future-proof architecture is planned and the implementation meets the technical quality standards Write stories and associated acceptance criteria for agile/scrum workflow Coordinate between multiple disciplines and stakeholders Ensure that projects are delivered in line with client processes and methodologies, with focus on agile approaches Establish a strategy of continuous delivery risk management that enables proactive decisions and actions throughout the delivery life cycle Measure and improve delivery productivity, serve as a consultant to Data Engineers and perform production support and deployment activities Requirements 3+ years of experience in SQL, Spark and Scala Expertise in Databricks Background in designing and implementing ETL/ELT pipelines and large batch/micro batch processing systems Familiarity with data services solutions using Spring Boot, ReactJS and NoSQL or other UI and API related technologies Understanding of agile/scrum workflow and different delivery models Capability to provide technical leadership and act as a consultant to Data Engineers English proficiency at B2 level or higher for direct communication with the client Nice to have Skills in Spark Streaming and Kafka Familiarity with Azure We offer International projects with top brands Work with global teams of highly skilled, diverse peers Healthcare benefits Employee financial programs Paid time off and sick leave Upskilling, reskilling and certification courses Unlimited access to the LinkedIn Learning library and 22,000+ courses Global career opportunities Volunteer and community involvement opportunities EPAM Employee Groups Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn Postúlate en Kit Empleo: kitempleo.com.co/empleo/1b18c3