Senior Data Software Engineer

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

We are looking for a Senior Data Software Engineer with experience in using Spark and ideally the Databricks platform to help us build new features around data ingestion, preparation, transformation and exchange related to the modeling process.

Responsibilities

• Creation of pipelines to ingest and transform client exposure and model result data
• Proposal of an innovative solution and proper architecture to allow efficient data transformation and exchange with an external vendor modeling platform
• Evaluation and continuous improvement of the performance of the pipelines
• Review of the work of colleagues and provision of feedback

Requirements

• Minimum 3 years of professional experience in software development
• Strong background in big data engineering development with PySpark
• Expertise in Databricks and the cloud-based lakehouse architecture
• Working experience in an Agile environment (SCRUM)
• Good communication skills
• Upper-Intermediate English language proficiency (B2)

Nice to have

• Expertise in SQL Server management (restore/backup/convert databases)
• Familiarity with infrastructure as code tools (Terraform/Ansible) in cloud environments
• Knowledge of Azure cloud
• Skills in DevOps

We offer

• We believe that the greatest strength of the company is its people. EPAM is fully committed to help its employees to reach their full potential and achieve their professional goals through continues learning. With this in mind, we would like to introduce to you few of the many opportunities and services which we believe will help you expand your current knowledge:
• Full access to cutting-edge tools and technologies
• Competitive compensation depending on experience and skills
• All-around Social package: professional & soft skills training, medical & family care programs, sports
• Relocation opportunities
• Free English classes
• Unlimited access to LinkedIn learning solutions
• Continuous experience exchange with experts and professionals worldwide
• Friendly team and comfortable working environment
• Engineering, corporate, and social events within and outside the Company
• Flexible working schedule
• Opportunities for self-realization