Log In
Sign Up
br{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]>
Job Purpose: The Data Quality & Automation Engineering Lead is a fully-participating member of a cross-functional team working autonomously on technology development and problem resolution in the Enterprise Data & Analytics space. The role involves leading and championing quality practices along with designing and implementing data quality and automation platforms. They will also provide support and maintenance to technical analytics solutions and products that support Emirates Airlines and the Emirates Group businesses. Job Outline: 1. Work with product owners, analysts, software engineers and architects to drive understanding of technical landscape and context of deliveries & refine complex functional and non-functional requirements and translate to acceptance tests. 2. Support in building the technical design by contributing in the analysis of data application and ensuring quality related features are baked into the solution. 3. Work on and guide engineers on problems of diverse scope where analysis of data requires evaluation of identifiable factors and select methods to validate and automate the solution. 4. Drive & mentor creation of test strategies and test plans validating the core business problem and translating them into tests around code functionality, data quality, performance, and security. 5. Build components & liase with teams across the organization to manage cross dependencies for generating / mocking test data for exploratory analysis and running tests. 6. Build platforms for automated tests / jobs of moderate to high scope and complexity across all stages of the data pipeline. Conduct code reviews to check for good coding & design practices and adherence to published coding standards and guidelines. 7. Build and enhance data quality rules and platforms for observability across the data pipeline 8. Perform and support team debugging complex issues, resolve blockers. 9. Advocate and perform data analysis activities such as source system analysis, data modelling, data dictionary collection, data profiling and source-to-target mapping ensuring delivery on business needs. 10. Advocate and participate in updating data inventories and registries as required to keep metadata and data lineage up-to-date, following agreed Data Governance standards, guidelines and principles.
Qualifications & Experience: Information Technology.Other : 5+ years Data Engineering experience with focus on quality & automation – Minimum 4+ years of testing, automation and support experience in analytics applications such as Data Lake and Data Warehouse (preferably using the Big Data stack and Microsoft Azure cloud infrastructure – Worked in a team leadership role building culture and practices around quality and developing trustworthy data assets – Seasoned in building data quality platforms for highly complex data architectures performing automated checks running in a CI and in production for data observability – Experienced in leading team to build enablers / practices to identify quality issues across complex data pipelines running on big data technologies and defining rules for validating health of the data – Proficient in at least 1 language (Scala / Python) for building ETL jobs in a distributed computing environment – Strong SQL quering skills is required – Experienced in a wide variety of testing methods and tools covering functional, performance, security tests across indivudal jobs, pipelines and end to end across enterprise. – Good understanding of data architecture concepts such as data modelling, Big Data storage, and dimensional modelling – Good experience of working with jobs in data pipelines and define metrics / measures to ensure correctness of the data – Experience with batch and real-time data ingestion/integration tools and technologies handling massive quantities of data (structured and unstructured) – Exposure to Spark is highly desirable – Airline industry experience is nice-to-have Knowledge/Skills: – Can collaborate with multiple teams / programs to deliver solutions interactively – Experienced with leading a team of engineers to achieve product and business goals and displays a positive attitude – Can mentor engineers and provide technical leadership in designing solutions – Strong ability to conduct data analysis (e.g. source system identification, data dictionary / metadata collection, data profiling, source-to-target mapping) – Self-starter and has passion for exploring and learning new technologies, especially those in the Enterprise Data & Analytics space – Team player; able to collaborate with others to remove blockers, solve complex design problems and debug/resolve issues – Strong oral and written communication skills with demonstrable experience communicating cross-functionally with architects and product owners in formal and informal settings – Strong organizational, planning, and follow-up skills and ability to hold others accountable. – Strong people management skills with a proven ability to hire and grow teams of Data Quality engineers
Salary & Benefits: Join us in Dubai and enjoy an attractive tax-free salary and travel benefits that are exclusive to our industry, including discounts on flights and hotels stays around the world. You can find out more information about our employee benefits in the Working Here section of our website www.emirates.com/careers. Further information on what’s it like to live and work in our cosmopolitan home city, can be found in the Dubai Lifestyle section.
Qualifications & Experience: Information Technology.Other : 5+ years Data Engineering experience with focus on quality & automation – Minimum 4+ years of testing, automation and support experience in analytics applications such as Data Lake and Data Warehouse (preferably using the Big Data stack and Microsoft Azure cloud infrastructure – Worked in a team leadership role building culture and practices around quality and developing trustworthy data assets – Seasoned in building data quality platforms for highly complex data architectures performing automated checks running in a CI and in production for data observability – Experienced in leading team to build enablers / practices to identify quality issues across complex data pipelines running on big data technologies and defining rules for validating health of the data – Proficient in at least 1 language (Scala / Python) for building ETL jobs in a distributed computing environment – Strong SQL quering skills is required – Experienced in a wide variety of testing methods and tools covering functional, performance, security tests across indivudal jobs, pipelines and end to end across enterprise. – Good understanding of data architecture concepts such as data modelling, Big Data storage, and dimensional modelling – Good experience of working with jobs in data pipelines and define metrics / measures to ensure correctness of the data – Experience with batch and real-time data ingestion/integration tools and technologies handling massive quantities of data (structured and unstructured) – Exposure to Spark is highly desirable – Airline industry experience is nice-to-have Knowledge/Skills: – Can collaborate with multiple teams / programs to deliver solutions interactively – Experienced with leading a team of engineers to achieve product and business goals and displays a positive attitude – Can mentor engineers and provide technical leadership in designing solutions – Strong ability to conduct data analysis (e.g. source system identification, data dictionary / metadata collection, data profiling, source-to-target mapping) – Self-starter and has passion for exploring and learning new technologies, especially those in the Enterprise Data & Analytics space – Team player; able to collaborate with others to remove blockers, solve complex design problems and debug/resolve issues – Strong oral and written communication skills with demonstrable experience communicating cross-functionally with architects and product owners in formal and informal settings – Strong organizational, planning, and follow-up skills and ability to hold others accountable. – Strong people management skills with a proven ability to hire and grow teams of Data Quality engineers
Salary & Benefits: Join us in Dubai and enjoy an attractive tax-free salary and travel benefits that are exclusive to our industry, including discounts on flights and hotels stays around the world. You can find out more information about our employee benefits in the Working Here section of our website www.emirates.com/careers. Further information on what’s it like to live and work in our cosmopolitan home city, can be found in the Dubai Lifestyle section.