Senior Cloud Platform Data Engineer / Cloud Architect

Job title:

Senior Cloud Platform Data Engineer / Cloud Architect

Company

Avance Consulting

Job description

Your Role:We are seeking a highly skilled and experienced Senior Cloud Platform Data Engineer(SME) to join our dynamic Payment Gateway team in Fleet UK for a Full time Hybrid role. Asan SME you will serve as a subject matter expert providing technical leadership guidanceand best practices across the team. You will play a critical role in designing developing and implementing complex datasolutions on cloud platforms (primarily AWS) ensuring they meet the higheststandards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering providing technicalguidance and mentorship to the team. Drive the design development and implementation of complex data pipelines andETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS LambdaAWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineagedocumentation. Collaborate with data analysts data scientists business stakeholders and productowners to understand their data needs and translate them into innovative andeffective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks andproduction incidents. Participate in the evaluation selection and implementation of new data technologiesand tools. Adhere to and champion best practices in data engineering including data securityprivacy and governance. Define and enforce data engineering standards processes and best practices withinthe team. Develop and maintain CI/CD pipelines for data engineering workflows using tools likeJenkins. Automate data ingestion transformation and loading processes. Work closely with DevOps teams and other engineering teams to ensure smoothdeployment and operations of data pipelines. Experience working on Linux platforms and managing data on Linux servers. Stay abreast of the latest advancements in cloud computing and data engineeringtechnologies. Contribute to the development and improvement of the team’s overall performanceand efficiency. May lead small projects or initiatives within the data engineering team.Your Profile 7+ years of experience in data engineering with a strong focus on cloud platforms(preferably AWS). 3+ years of experience as a Senior Engineer or SME in a data engineering role. Solid experience working on Linux platforms. Experience with CI/CD pipelines andtools like Jenkins. Strong understanding of DevOps methodologies and principles. Solid understanding of data warehousing data modeling and data integrationprinciples. Proficiency in at least one scripting/programming language (e.g. PythonScala Java). Experience with SQL and NoSQL databases. Familiarity with data quality and data governance best practices. Strong analytical and problem-solving skills. Excellent communication interpersonal and presentation skills. Desired Skills: Experience with containerization technologies (e.g. DockerKubernetes). Experience with data streaming platforms (e.g. Kafka Kinesis). Experience with data visualization and business intelligence tools. Experience with Agile development methodologies. AWS Certifications (e.g. AWS Certified Data Analytics – Specialty AWS CertifiedSolutions Architect)

Expected salary

Location

London

Job date

Tue, 15 Apr 2025 22:00:57 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (jobsjobs.org) you saw this job posting.