Overview

We are looking for a Senior Data Software Engineer with strong expertise in Apache Airflow and Databricks to join our data engineering team. In this role, you will design, build, and maintain scalable data pipelines, support machine learning workflows, and help migrate existing systems to modern cloud-based platforms.

Responsibilities:
  • Develop new data pipelines and maintain existing ones
  • Migrate existing data pipelines from BDP to Databricks
  • Maintain ML ETL pipelines and apply necessary changes to ML code
  • Monitor daily pipelines and resolve issues as they arise
  • Support ML model development, training, and deployment
  • Perform data integration and transformation through ETL processes
  • Contribute to database design, optimization, and data quality assurance
  • Document processes and workflows in clear and unambiguous language
  • Collaborate with the team using BitBucket, Jira, Confluence, and Teams
Required Qualifications:
  • 3+ years of experience in data engineering with advanced Proficiency in Python, Spark, and PySpark
  • Hands-on experience with Databricks and AWS
  • Background in ML model development, training, and deployment
  • Skills in data pipeline development, maintenance, and ETL processes
  • Understanding of database design, optimization, and data quality assurance
  • Fluent in English with strong documentation skills
  • Result-oriented and proactive approach to problem-solving
Benefits:
  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events
  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to EPAM's internal learning database
  • Free English classes with certified teachers
  • Participation in the Employee Stock Purchase Plan
  • Monetary bonuses for engaging in the referral program
  • Comprehensive medical & family care package
  • Four trust days per year for personal needs
  • Discounts for fitness clubs
  • Benefits package (hotels, restaurants, stores and services)
Nice To Have:
  • Familiarity with pandas
  • Knowledge of Databricks with MLFlow or AWS Sagemaker
  • Data Software Engineering
Note:

✨ Our intelligent job search engine discovered this job and republished it for your convenience.
Please be aware that the job information may be incorrect or incomplete. The job announcement remains the property of its original publisher. To view the original job and its full details, please visit the job's URL on the owner’s page.

Please clearly mention that you have heard of this job opportunity on https://ijob.am.