176 to 200 of 385 Data Engineer Jobs in London

I'm currently looking for a Data Engineer for an Insurance client of mine based in London. The ideal candidate will have 4+ years of Data Engineering experience and will have experience with DataBricks, SQL and Python. This is a 6-month contract that requires 2 days more »

Are you ready to join a global investment manager who are at the forefront of shaping the future of data technology? You’ll play an integral role in the new team where you will be instrumental in driving the development of their new data analytics platform. Your contributions … about technology; then this could be the perfect role for you. Key Responsibilities: Spearhead the architectural design and implementation of a greenfield cutting-edge data platform, contributing to the transformation of our client's data landscape. Collaborate with a cross-functional team of software engineers, data engineers … and data analysts to support and enhance both existing and new data platforms. Varied role including improving the data quality and software development Be the driving force in identifying anomalies within the data, leveraging your expertise to enhance decision-making processes and optimise the value derived more »

Location: London Hybrid: 2/3 days in Salary: £85,000 (DOE) Are you a snowflake senior data engineer looking to work on a NetZero focused product? This role is for a disruptive greenfield project that's found within a multi-billion-pound business delivering critical work - it more »

Location: London Hybrid: 2/3 days in Salary: £100,000 (DOE) Are you a lead snowflake data engineer looking to work on a NetZero focused product? This role is for a disruptive greenfield project that's within a multi-billion-pound business delivering critical work - it's … only been live for 2 years and has already become one of their most successful products 🌱 Alongside leading other highly talented data engineers, you’ll also be working for a company who really value their employees. As a testament to this, you’ll also receive an unrivalled benefits package. more »

Data Science & ML Consultant Location : London – Hybrid Employment : Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity : For the Ministry of Defence (MOD), maintaining national security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with … this Big 4 Firm to support its multidisciplinary Data Science and Machine Learning team within DSSV (Data Science, Simulation and Visualisation). The Teams work together to drive innovation and insight from data, using cutting-edge Data Science and Machine Learning techniques alongside Digital Transformation to … solve complex problems through AI and Data. The Role : Working closely with senior data scientists, the Consultant's responsibilities span the entire data science lifecycle, from Proof of Concept to fully tested production solutions. Additional duties include preparing technical documentation, participating in client proposal responses, and pitching data more »

About Tredence­: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making. … development methodology; think strategically and execute methodically Develop and manage capacity and growth projection forecasts of the environment within budgets Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements Drive optimization, testing and tooling to improve quality … 8+ years of relevant experience At least two years of experience building and leading highly complex, technical engineering teams. Strong hands-on experience in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills more »

is fragile and career outlook right now is very uncertain. What about working at a hedge fund where their growth is almost certain? This data engineering team hired multiple people last year – most from big-tech – and plan to do the same this year. A large portion of your … work will technically be non-finance, with the main finance focused work completed by other teams. The real-world, complex data engineering problems are all yours. You’ll be joining a team that builds and has built thousands of ingestion pipelines, with data coming from every single potential … avenue it possibly can. To get the best understanding of an investment, all data points are considered. You’ll bring the data into the business, build the data infrastructure around it and deliver the data to the right person in the business to build their investment more »

is fragile and career outlook right now is very uncertain. What about working at a hedge fund where their growth is almost certain? This data engineering team hired multiple people last year – most from big-tech – and plan to do the same this year. A large portion of your … work will technically be non-finance, with the main finance focused work completed by other teams. The real-world, complex data engineering problems are all yours. You’ll be joining a team that builds and has built thousands of ingestion pipelines, with data coming from every single potential … avenue it possibly can. To get the best understanding of an investment, all data points are considered. You’ll bring the data into the business, build the data infrastructure around it and deliver the data to the right person in the business to build their investment more »

Role Profile Enter role description, key responsibilities, and job description: Hands on Senior Engineer with experience of working within high performance development teams Significant AWS Engineering experience implementing Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python … Python data management/manipulation libraries and usage of Python with AWS components Demonstrable experience working in the Data domain, covering the full data pipeline from ingestion, mastering, management and consumption/distribution of large datasets Financial Services expertise preferred working with Equity and Fixed Income asset … classes and a working knowledge of Indices Experience with No-SQL and Relational databases and data analysis using SQL. Enter key behaviours and skills required to be successful in the role: Education & Work experience: 7+ years of AWS and Python development engineer experience within the Financial Services and more »

in the office Salary: Up to £160k + Bonus A tech-driven investment firm in the city is looking to add a number of Data Engineers to their big build-out. The firm has set up a new team, focused on building a massively distributed cloud-hosted data … Dremio, Snowflake, Iceberg, PySpark, Glue, EMR, dbt and Airflow/Dagster. Cloud: AWS, Lambdas, ECS services This role would focus on various areas of Data Engineering including: End to End ETL pipeline development and deployment onto the Cloud Contributing to a centralised Data platform's architecture and design. … Extract, transform and load data from various sources into the data lakehouse. Metadata Management processes and tools Implementing Data Curation, metadata management and data quality tooling. Requirements: Strong Python/Java Software Engineering skills Excellent AWS knowledge, ideally with exposure to Airflow, Glue, Iceberg and Snowflake more »

in the office Salary: Up to £160k + Bonus A tech-driven investment firm in the city is looking to add a number of Data Engineers to their big build-out. The firm has set up a new team, focused on building a massively distributed cloud-hosted data … Dremio, Snowflake, Iceberg, PySpark, Glue, EMR, dbt and Airflow/Dagster. Cloud: AWS, Lambdas, ECS services This role would focus on various areas of Data Engineering including: End to End ETL pipeline development and deployment onto the Cloud Contributing to a centralised Data platform's architecture and design. … Extract, transform and load data from various sources into the data lakehouse. Metadata Management processes and tools Implementing Data Curation, metadata management and data quality tooling. Requirements: Strong Python/Java Software Engineering skills Excellent AWS knowledge, ideally with exposure to Airflow, Glue, Iceberg and Snowflake more »

organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first to … respond to data health failures on key pipelines. You will be comfortable reading code to identify fixes and making changes. Core Responsibilities build schedules so that pipelines run effectively. up and maintaining health checks on different data pipelines Triage, and debug the data pipeline when broken. code … and writing code changes and/or modifying the monitoring set-up and understanding how to navigate the data pipelines and documentation. Standard Operating Procedures to contact other teams and data providers when data is incorrect or not received on time. outages with the end users of more »

I am working with a market leading Advertising client, who are currently hiring a Senior Data Engineer. Data is a key component for this client, and this opportunity will allow you to shape and build there Data platform. You will be involved in the design and construction … of new data capabilities from the ground up, and is a unique opportunity to influence key architectural decisions. The role is split with up to 70% of your time being dedicated to designing and writing software, 30% managing infrastructure. What you'll be working on Designing APIs around data … streaming joins. Building a high throughput service to push events to third parties. Managing key infrastructure such as Kafka, Aurora, DynamoDB, and owning the Data infrastructure. We see around 3 Billion kafka messages per day. Key infrastructure migration and upgrades. Write software using Java/Python/Scala. You more »

I am working with a market leading Advertising client, who are currently hiring a Senior Data Engineer. Data is a key component for this client, and this opportunity will allow you to shape and build there Data platform. You will be involved in the design and construction … of new data capabilities from the ground up, and is a unique opportunity to influence key architectural decisions. The role is split with up to 70% of your time being dedicated to designing and writing software, 30% managing infrastructure. What you'll be working on Designing APIs around data … streaming joins. Building a high throughput service to push events to third parties. Managing key infrastructure such as Kafka, Aurora, DynamoDB, and owning the Data infrastructure. We see around 3 Billion kafka messages per day. Key infrastructure migration and upgrades. Write software using Java/Python/Scala. You more »

Senior Data Platform Engineer Location: 🌐 Hybrid working across the UK with a central London base of operations 🌐 Eligibility: You must either possess or be eligible to apply for Security Clearance (SC) Salary range: 💷 £80,000 to £105,000 💷 Technology: AWS/Azure, Python, CI/CD Burns Sheehan more »

Our client are a renowned name in the Property Sector, they are on the lookout for 2 AWS Data Engineers to come in on a contract basis. Key Skills/Requirements: Must have Python & Spark experience Must have strong AWS experience Must have Terraform experience SQL & NoSQL experience Have … built out Data Warehouses & built Data Pipelines Strong Databricks & Snowflake experience Docker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to have Contracts are running for 6 months initially, paying up to £450p/day (Outside IR35) and will be mostly remote but ideally looking more »

Our client are a renowned name in the Property Sector, they are on the lookout for 2 AWS Data Engineers to come in on a contract basis. Key Skills/Requirements: Must have Python & Spark experience Must have strong AWS experience Must have Terraform experience SQL & NoSQL experience Have … built out Data Warehouses & built Data Pipelines Strong Databricks & Snowflake experience Docker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to have Contracts are running for 6 months initially, paying up to £450p/day (Outside IR35) and will be mostly remote but ideally looking more »

BettingJobs are working with an established sports betting odds provider who are based in London who are looking to add a Data Acquisition Engineer to their team. Responsibilities: Develop, test, run and monitor software that consumes data efficiently from approved sources. Ensure proper documentation is written and … date. Adopt and follow a good pace of software refactoring ensuring fast delivery of accurate data. Use internal tools to evaluate and validate all data acquired. Ensure all data shipped to the customers meets the quality standards. Quickly address customer issues following escalation from the Client Services Team … Keep learning and improving, sharing the acquired knowledge with the wider group. Maintain good relationships with wider Data Acquisition Team. Maintain clear and open path of communication with Client Services Team. Requirements: Coding proficiency preferably in Scala; alternatively Java, Python or any other high level language. A Bachelors degree more »

Senior Data DevOps As a Senior Data DevOps you will be responsible for designing, implementing, and maintaining the infrastructure and deployment pipelines for our analytics solutions in the cloud. Reporting to the Senior Data Engineering Manager, you will be part of the Data Operations Team. This … and maintain automated deployment pipelines for analytics applications Implement continuous integration and continuous delivery (CI/CD) practices. Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to ensure seamless integration of analytics solutions. Implement monitoring and logging solutions to proactively identify and address issues. Optimize … cloud resources for cost efficiency and performance. Implement security best practices for analytics solutions in the cloud. Ensure compliance with relevant data protection and privacy regulations. Maintain comprehensive documentation for infrastructure, configurations, and processes. Provide support to other team members, including code reviews, knowledge sharing and mentoring, while fostering more »

Senior Data DevOps As a Senior Data DevOps you will be responsible for designing, implementing, and maintaining the infrastructure and deployment pipelines for our analytics solutions in the cloud. Reporting to the Senior Data Engineering Manager, you will be part of the Data Operations Team . … and maintain automated deployment pipelines for analytics applications Implement continuous integration and continuous delivery (CI/CD) practices. Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to ensure seamless integration of analytics solutions. Implement monitoring and logging solutions to proactively identify and address issues. Optimize … cloud resources for cost efficiency and performance. Implement security best practices for analytics solutions in the cloud. Ensure compliance with relevant data protection and privacy regulations. Maintain comprehensive documentation for infrastructure, configurations, and processes. Provide support to other team members, including code reviews, knowledge sharing and mentoring, while fostering more »

days p/w in office Salary: £75,000-£85,000 Industry: Insurance Tech Stack: Python, SQL, Spark, Azure 👩🏻‍💻 Great opportunity for a talented Engineer (Python, SQL, Spark, Azure) to join a market leading cyber insurance company. The Company 🚀 Tech driven insurance business that are expanding into emerging risk … by over 100,000 business around the world to provide unique, competitive and secure insurance packages. The Role ✨ They are seeking a highly pragmatic Engineer (Python, SQL, Spark, Azure) to help build out their new data platform. You (Python, SQL, Spark, Azure) will work closely with Architects, Data … heart of London with work from home options Opportunity to work in small, diverse and skilled cross-functional teams If you are a skilled engineer (Python, SQL, Spark, Azure) who is interested in this role then please apply below and I will be in touch with more details. If more »

days p/w in office Salary: £75,000-£85,000 Industry: Insurance Tech Stack: Python, SQL, Spark, Azure 👩🏻‍💻 Great opportunity for a talented Engineer (Python, SQL, Spark, Azure) to join a market leading cyber insurance company. The Company 🚀 Tech driven insurance business that are expanding into emerging risk … by over 100,000 business around the world to provide unique, competitive and secure insurance packages. The Role ✨ They are seeking a highly pragmatic Engineer (Python, SQL, Spark, Azure) to help build out their new data platform. You (Python, SQL, Spark, Azure) will work closely with Architects, Data … heart of London with work from home options Opportunity to work in small, diverse and skilled cross-functional teams If you are a skilled engineer (Python, SQL, Spark, Azure) who is interested in this role then please apply below and I will be in touch with more details. If more »

days p/w in office Salary: £90,000 - £120,000 Industry: Insurance Tech Stack: Python, SQL, Spark, Azure 👩🏻‍💻 Great opportunity for a talented Engineer (Python, SQL, Spark, Azure) to join a market leading cyber insurance company. The Company 🚀 Tech driven insurance business that are expanding into emerging risk … by over 100,000 business around the world to provide unique, competitive and secure insurance packages. The Role ✨ They are seeking a highly pragmatic Engineer (Python, SQL, Spark, Azure) to help build out their new data platform. You (Python, SQL, Spark, Azure) will work closely with Architects, Data … heart of London with work from home options Opportunity to work in small, diverse and skilled cross-functional teams If you are a skilled engineer (Python, SQL, Spark, Azure) who is interested in this role then please apply below and I will be in touch with more details. more »

Push the boundaries of BI, building complex data pipelines and beautiful visualisations for all kinds of business users at this $50bn Hedge Fund. Every business user here understands the power and importance of data for them to do their jobs and for the business to excel. You don … t need to understand what a Hedge Fund does, but you’ll need to be adaptable and eager to learn. You’ll take data requirements direct from the business users and you’ll be given freedom and support to come up with your own ideas to give the best … operate with modern tech such as Snowflake, Airflow, DBT, Kubernetes/Docker and cubeJS whilst also using Tableau CRM and Jupyter notebooks for gaining data insights. If you think there’s a better or newer tool, you’re free to use that too. The key think is that you more »

Push the boundaries of BI, building complex data pipelines and beautiful visualisations for all kinds of business users at this $50bn Hedge Fund. Every business user here understands the power and importance of data for them to do their jobs and for the business to excel. You don … t need to understand what a Hedge Fund does, but you’ll need to be adaptable and eager to learn. You’ll take data requirements direct from the business users and you’ll be given freedom and support to come up with your own ideas to give the best … operate with modern tech such as Snowflake, Airflow, DBT, Kubernetes/Docker and cubeJS whilst also using Tableau CRM and Jupyter notebooks for gaining data insights. If you think there’s a better or newer tool, you’re free to use that too. The key think is that you more »