Data Engineer / Data Architect

POSITION DESCRIPTION

Data Architect / Data Engineer

Reporting to

Team Leader/Manager

Role objective and overview

Work with Global Customer and Marketing Insights team to design and implement a big data architecture with the appropriate levels of scalability, flexibility, resilience, security, and automation to meet the business needs for analytics / insights.

Key result areas

  • Designing and implementing big data solutions / architectures and pipelines and selecting appropriate methods / tools / services to meet functional requirements and non-functional requirements (e.g., performance and cost-efficiency)
  • Ensuring data is managed in a controlled, sustainable, secure, and compliant way
  • Evaluating the quality of the data and identifying where in the end-to-end pipeline issues need to be addressed
  • Interpreting current business needs and anticipating future analytics / insights needs
  • Acting as data architecture / data engineering SME

Knowledge, qualifications, and experience

Essential:

  • Expertise in designing and implementing cloud-based solutions / architectures and ELT and ETL pipelines for storing, processing, and modelling structured, semi-structured and unstructured big data, ideally on Azure
  • Understanding of structured, semi-structured and unstructured data and how to model / combine data of similar and different structure
  • Understanding of relational databases and SQL, and document databases, blob storage and NoSQL;
  • Understanding of master data principles
  • Expertise in automation, CI / CD, DevOps / MLOps / DataOps and similar methodologies

Desirables

  • Expertise in data mesh / service-oriented architecture
  • Power BI (or similar) architecture, implementation planning (e.g., workspaces, security, auditing), admin, automation, and deployment (e.g., deployment pipelines, monitoring, troubleshooting), data modelling and transformation, optimisation
  • Microsoft Purview (or similar) architecture, implementation planning, admin, automation, and deployment
  • Understanding of streaming data solutions / architecture

Next step

Apply via email:
To apply for the position above, please forward your CV to recruitmentindia@hays.com or hbs.hr@hays.com and our HR SPOC will connect with you.