We're seeking a highly skilled and motivated Senior DataEngineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and Snowflake … and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data warehouses to support … analytical workloads and reporting needs - Partner with data scientists, analysts, and product teams to deliver reliable, well-documented datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/ More ❯
london (city of london), south east england, united kingdom
Luxoft
We're seeking a highly skilled and motivated Senior DataEngineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and Snowflake … and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data warehouses to support … analytical workloads and reporting needs - Partner with data scientists, analysts, and product teams to deliver reliable, well-documented datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/ More ❯
role The Experimentation Platform team is dedicated to supporting the business by operating JET's internal feature management and experimentation platform, JetFM. This involves processing vast amounts of experiment data, and thoroughly analysing and interpreting the results. Your primary goal in this role is to help scale the use and scope of this state-of-the-art experimentation platform … curve for users and driving greater volume of experiments. What would that look like in your day-to-day work? A big part of the role is developing complex data pipelines in Python operating on massive amounts of data in Big Query. But the work asks for a a more versatile engineering skillset, not limited to traditional … data engineering: evolving backend APIs, productionising statistical methodologies at scale, integration with other platforms or building data tools as required. You will collaborate closely with other engineers, data scientists, and analysts as part of a broader engineering community. These are some of the key components to the position: Design, develop, and maintain reliable and scalable dataMore ❯
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for jobseekers and companies around the world to find a perfect match in fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and unbiased hiring. Join our … platform. Job Description Join our team and youll be responsible for working with one of our scrum teams to help us keep our customers happy, solve the challenges of data warehousing in a rapidly growing platform whilst in an evolving marketplace. Working in the commercial data solutions team, we are making significant investment in business intelligence, data products and data warehousing at scale; and we will invest in you. This is so important to us. By joining our team, you will be playing a vital role as together we reimagine the labour market to make it work for everybody. Start your day with a stand up, then spin up your environment and bham, you're More ❯
