Overview
“Simply Technologies” is looking for a “Senior Data Engineer”.
- Lead the gathering and processing of data at scale
- Influence technical direction, choosing the best tools and approaches for the job at hand
- Design and deliver high-quality features that are testable, maintainable, scalable, monitorable, reusable, and efficient
- Design, develop and maintain data solutions that will enable the BI and analytics solutions, inclusive of ETL, data aggregation, and custom calculations following data governance best practices
- Provide technical expertise, guidance, advice and knowledge transfer on aspects of code management, automated release builds, and code deployment
- Develop end-to-end cloud-based data production pipelines
- Influence successful delivery by discussing scope trade-offs, doing design and code reviews, planning, and delegating
- Translate complex functional and technical requirements into detailed architecture, design, and high-performing solutions and applications
- Work with peer developers to make sure that all data solutions are consistent, upholding data integrity and following data integration best practices
- 5+ years of experience in development and cloud Data Processing applications
- 3+ years of strong Analytics/ETL experience
- Hands-on experience on Cloud-based services such as Google Cloud Platform (GCP), Amazon Web Services (AWS) or Microsoft Azure
- Experience in building highly scalable distributed data pipelines using open source tools and big data technologies such as Spark, Kafka or Beam
- Development experience with Python, Java or Scala
- Experience with UNIX tools and shell scripting
- Solid SQL skills for querying databases and data-lakes (e.g., BigQuery, Hive, SQL Server, DB2, MySQL, etc)
- Proven ability to work independently, be self-motivated with a high degree of intellectual curiosity
- Understanding of Machine Learning, Data Processing, Fundamental Data Structures, and Algorithms
Good level of spoken and written English