51 to 75 of 488 Data Engineer Jobs in the UK

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

Harris Global are currently on the lookout for a Senior Data Analytics Engineer to join our global client on a permanent basis. The successful candidate will have a strong data background with a mix of analysis and engineering skills, must have strong business acumen and be able … stakeholders at all levels. Candidates MUST have experience working with Snowflake, Azure and Tableau. Key skills will include: Minimum 5+ years experience working within Data Must have Snowflake, Tableau and Azure experience Experience designing and implementing complex data platforms with a variety of OLTP and OLAP workloads and … a mix of real-time and batched data flows connecting internal and third-party systems Demonstrated good data analysis skills and able to distil and present relevant insights from raw system data using data manipulation languages Matillion/Power BI would also be nice Have experience more »

Senior Data Engineer (AWS) Up to £85,000 Salary + Bonus London office 2-3 days per week. OVERVIEW A very successful AI scale up in the creative space are hiring for a Senior Data Engineer (AWS) to join their well established Data team, spearheading … some of their key Data Engineering projects in AWS and mentoring junior team members. Your responsibilities as a Senior Data Engineer will include not be limited to: Lead key Data Engineering projects in the business using your knowledge and experience in AWS. Engage and communicate with … technical projects of the business. Mentor more junior team members and guide them on projects you're leading. YOUR SKILLS & EXPERIENCE A successful Senior Data Engineer (AWS) will have the following: Minimum of 4 years commercial experience Strong proficiency in AWS and relevant technologies Good communication skills Preferably more »

Data Engineer Location: London – Hybrid Employment: Full Time All applicants must hold a SC or DV (Developed Vetting) clearance to apply. The Opportunity: For the UK Government, maintaining National Security is a 24-hour-a-day, 365-day-a-year mission. To support these complex operations, the MoD … partners with this Big4 Firm to empower critical thinking and drive value across its strategic initiatives and Data & AI technology investments. The Role: As an AI & Cloud Data Engineering practitioner, you’ll build large-scale data pipelines and infrastructure, utilising data integration tools to optimise complex … data solutions. Collaborating with high-performing Data Science and ML Engineering teams to drive innovation and insight through AI and Data across the Defence & Security sector. Required Skills/Experience: British Passport Holder with active DV (Developed Vetting Clearance) End-to-end development with data pipelines more »

Data Engineer - London - Up to £75,000 p/a Due to a rapid and extensive digital transformation a Top 500 Law firm with a global following are now looking to add a Data Engineer to their pack. You will not find a better time to … where you will get the opportunity to build a number of greenfield projects from scratch and be a leading voice within the firm on data experience for both internal and external staff. Within a small scrum of 4 data engineers, on a day to day basis you'll … be providing pipeline and data support to the data analysts, to ensure their end users get the right data and experience from day one which aligns with the firms values. You'll achieve this by using your highly impressive skill set to consolidate the mass of quality more »

pension plan of an additional 5% of your base salary paid by us monthly to save for your future. Your Role and Responsibilities Develop data products to enable onward use of data by product teams. Support the client's architecture community in solution design Ensure solution design adheres … to best practice. Develop future roadmap of data processing capabilities: Create implantation of data processes to transform raw service outputs according to data science use case needs. Create data linking mechanisms to remove barriers to data access Develop and deploy Infrastructure as code using a … template standard. Work on processes deployed and running in production. Required Technical and Professional Expertise Experience of working with Azure data platform - building ETL in Azure Data Factory, taking data from Azure Data Lake into star schemas in Azure Synapse. Preferred Technical and Professional Expertise Databrix more »

Push the boundaries of BI, building complex data pipelines and beautiful visualisations for all kinds of business users at this $50bn Hedge Fund. Every business user here understands the power and importance of data for them to do their jobs and for the business to excel. You don … t need to understand what a Hedge Fund does, but you’ll need to be adaptable and eager to learn. You’ll take data requirements direct from the business users and you’ll be given freedom and support to come up with your own ideas to give the best … operate with modern tech such as Snowflake, Airflow, DBT, Kubernetes/Docker and cubeJS whilst also using Tableau CRM and Jupyter notebooks for gaining data insights. If you think there’s a better or newer tool, you’re free to use that too. The key think is that you more »

What's in it for you?… Working for a respected and certified Data & AI Microsoft Solution Partner specialising in Analytics, AI and Machine Learning, that will help you gain Microsoft certifications; Joining a rapidly expanding and innovative organisation with exciting plans for 2024, that will give you the freedom … to grow as an Azure Data professional, with a clear career path; Working with clients across various industries on exciting projects that will see you utilising the latest products within the Microsoft Azure and SQL Data analytics stack; A flat hierarchy and no-door policy . You won … and technical perspective; A basic salary between £60k - £70k is on offer depending on your depth and breadth of experience in delivering SQL Azure Data Platform & Microsoft Business Intelligence solutions and if you have previous experience working for a reputable data analytics consultancy. Multiple Senior Data Engineers more »

Data Engineer £55,000 - £65,000 per annum + benefits London Hybrid (3 days a week in office) Data Engineer | ETL | Data Pipelines | HealthTech | Beauty | Python | SQL | GCP | Azure | AWS | BigQuery | Cloud Functions | Pub/Sub | DataFlow | Data Studio | Shopify | Migration | Data Architect … This HealthTech scale-up is looking for a Data Engineer to support them as a no.2 within the department and manage their biggest migration to date. Core experience required: Python SQL GCP, Azure, or AWS cloud experience Problem solver Bonus experience required: GCP (BigQuery, Cloud Functions, etc.) Migration … experience to Shopify Interest in Data Architecture Exposure to Analytics of Data Science Data Engineer | ETL | Data Pipelines | HealthTech | Beauty | Python | SQL | GCP | Azure | AWS | BigQuery | Cloud Functions | Pub/Sub | DataFlow | Data Studio | Shopify | Migration | Data Architect more »

Senior Data Engineer/Up to £95k + Benefits//Global Facilities Services Business Senior Data Engineer 1 Day per Week in London Azure Stack & DataBricks Summary My client is seeking a highly skilled Senior Data Engineer to join their team. This role … involves building out a robust data platform on Databricks, with a primary focus on facilitating seamless data migrations. As a Senior Data Engineer, you will leverage your expertise in Databricks and data engineering to develop scalable solutions that enhance data integration, transformation, and accessibility … across the organization. Key Responsibilities responsible for designing, developing, and managing data ingestion processes and pipelines within Azure and Databricks environments. The role involves utilizing Databrick's medallion architecture to create well-defined and governed data consumption models, adopting a data-as-a-product mindset. The ideal more »

on Databricks process architect and engineering leader to drive our Databricks transformation, pipelines architecture, governance and engineering patterns. Our CDP delivers a unified Customer data model across our global CRM operations. In this role, you will be responsible for driving our Databricks migration, designing and executing a comprehensive pipeline … architecture strategy that aligns with CDP team's skillsets, business objectives and drives compliant, efficient and effective data management. RESPONSIBILITIES Drive our AWS Databricks transformation from current relational DB setup. Collaborate with our diverse teams, SQL developers/data engineers/CRM analysts, to develop, implement and maintain … sustainable, high-performance, growth-ready data-processing and data integration systems Provide best practice on CI/CD techniques with Git and Databricks Provide best practice on Databricks cluster management. Reviews and evaluates designs and project activities for compliance with privacy, architecture, security and quality guidelines and standards more »

A Data Engineer is sought to drive impactful data initiatives within a high performing organisation. The Data Engineer will spearhead data strategies and foster innovation across the operations. The organisation is a premier provider of essential products and services across Europe, dedicated to improving … quality and reliability in the sector. In this role, the data engineer will be pivotal in designing and executing solutions for the entire data lifecycle, including data acquisition, storage, modeling, transfer, hosting, visualisation, analysis, and consumption. The Data Engineer will also be responsible for … guiding and developing the skills of team members. Key Responsibilities: Architect and implement comprehensive data pipelines for efficient data acquisition, storage, processing, and interface creation. Generate both machine-readable interfaces and user-friendly data products, encompassing standard and custom reports. Ensure the maintenance and optimisation of data more »

engineering and validating the products of tomorrow for the world’s leading manufacturers. Due to our continued growth we are now recruiting for a Data Engineer to be based at our office in Gaydon Our Digital Enterprise Solutions (DES) Department leverages extensive manufacturing know-how for enlightened enterprise … world-class consultants enable organizations to realize the power of the integrated enterprise by providing superior consulting and implementation services. The Role: As Senior Data Engineer you will be responsible for Analysing archiving and reporting requirements, source and destination systems and their data models and designing data … solutions that meet the functional and non-functional requirements. You will work closely with Project Managers to deliver the program. Area of Responsibility Experienced Data Engineer with track record of creating large data tech solutions. Excellent understanding of the data tech solutions, specially Google Cloud. Data more »

Data Engineer - Leading Pharmaceutical Company - Bristol (Tech Stack: Data Engineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented Data Engineer looking for a new challenge? Our client, a leading pharmaceutical company based in Bristol, is seeking a dedicated and … skilled Data Engineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python for … data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth knowledge of more »

DATA ENGINEER CENTRAL LONDON - HYBRID (3 DAYS IN OFFICE) £50,000 - £60,000 THE COMPANY A leading provider of private student accommodations across the UK, catering to a diverse community of 34,000 students. With a commitment to excellence and innovation, they have recently transitioned their data … infrastructure from SQL Server to Azure, solidifying their position at the forefront of technology in the industry. THE ROLE Their team has successfully migrated data operations to Azure over the past two years. As a result, the entire data ecosystem resides in Azure, eliminating on-premises dependencies. Now … they are seeking a proficient Azure Data Engineer/Developer to ensure the seamless operation of their BI reporting systems. The role entails overseeing the management of the Azure data warehouse, providing analytical support to BI analysts, and maintaining data pipelines utilising SQL and PowerShell (function more »

Are you prepared to join a team of engineers in the Global Data Engineering division, dedicated to addressing intricate challenges at the intersection of trading and technology? Your focus will be on integrating global financial instrument identifiers with alternative data sources to enhance both new and existing trading … strategies. This role entails creating and implementing a robust data model and framework to standardize financial instrument identifiers globally across various vendors, markets, and historical periods, ensuring seamless integration with alternative datasets. To thrive in this role, proficiency in programming languages such as Python, C, or C++ is essential. … Experience in system design and deploying data solutions on a global scale is critical. Expertise in data modeling, particularly in financial instruments and alternative datasets, will be pivotal for seamless data integration. Strong interpersonal skills are necessary for effective stakeholder engagement. Moreover, you embody a sense of more »

This is an exciting opportunity to join one of Europe's fastest growing health-tech startups, working in a Data team that has made huge steps in moving our innovative platform forwards This role is Hybrid but only requires 1-2 days a month in our London office About … be the UK leader in revolutionising affordable care for the better, for our service users and society and the perfect coordination across care practice, data, science and technology is how we’ll get there. About Data at Cera Data has a critical role to play in two … distinct areas. First, data about our operations, covering everything from hiring and retaining carers to the delivery of care, helps us to observe and understand how we are performing, what is working and what we could do to better deliver care. Second, data about service users' health, covering more »

Job description: hands-on experience in business intelligence development or data engineering experience,Solid experience with data modelling, data warehouse design and data lake concepts and practices; Exposure working in a Microsoft Azure Data Platform environment. Exposer inAzure Data Factory Azure Storage Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics • Building new data pipelines and optimizing data flows using the Azure cloud stack. • Building data products from scratch. • Support … Business Analysts and Data Architects with discovery and best practices. • Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? • Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. • Experience building and optimizing ‘big more »

This innovative Systematic Trading firm , seeks an experienced and gifted Software Developer/Big Data Engineer with genuine expertise in Python to work within a fast paced Data team . You will work very closely with Quant Research, Trading, Quant Development and traditional ETL/ELT Data … enable the capture, ingestion, transformation, storage, and provision (up and downstream) of large alternate datasets covering structured, semi-structured, and unstructured - API Layer Central Data Platform Telemetry tools Bespoke Data tools for the front office teams Post 18-24 months successful tenure previous individuals have moved internally into … Analytics teams Opportunity for internal mobility to APAC and East Coast U.S promoted. Desired background and skills 3+ years of exp. as a Software Engineer/Big Data Engineer with an understanding of modern Data Architecture Previous Finance experience is NOT essential , you will develop a more »

Role : Senior Data Engineer (SAS) Role type : Open to both permanent & contract ( only inside ir35 ) Location : London & Edinburgh Work Mode : Remote , UK Senior Data Engineer (SAS) They want to rewrite existing pipelines (SAS, Info, pear, shell scripts) to target state which will be Python and DBT … loaded to SF on Azure. SAS (primary), pearl, shell scripts (secondary) engineers who has experience to convert to Python , DBT based pipelines and load data to Snowflake. Converting SAS based module to python based Candidates who have data management experience in Snowflake with expertise in Python, DBT , Airflow more »

serving active bulk annuity provider, and a market-leading, multi-award-winning business. Job Description We have an exciting new opportunity for a Lead Data Engineerto join us. The role holder will belead in all technical aspects of the data engineering projects whilst working closely with solution architects … scripting & automation Good knowledge of CI\CD automation NoSQL Database Technology such as MongoDB CDC and streaming technologies such as Qlik Replicate & Kafka Basic data architecture principles, solutioning and ETL experience and containerisation Knowledge of database structures such as relational and dimensional modelling and design Designing and developing streaming more »

Are you an experienced Data Engineer who wants to work at the cutting edge of engineering sustainability? Our client is on a mission to empower engineers to use AI to overcome their most difficult physics and design challenges and build truly great products. With strong product-market fit … last four years, are growing globally (50 employees and counting), and have ambitious plans to expand. In light of this, they are recruiting a Data Engineer to continue their growth and improve the capabilities of their products. This well-funded company was founded in 2016, and provides a … the UK and Europe*** ***Candidates must speak fluent English and not require sponsorship from an employer to live & work in their current country*** The Data Engineer will sit within the Data Science team. As part of this team, you’ll be at the forefront of innovation, working more »

Data Engineer Do you want to join a leading investment firm specializing in quantitative trading, driven by innovation and excellence? Keep reading! 📍 Location : London, UK As a Data Engineer , you'll build and maintain infrastructure for trading strategies, collaborating with data scientists and analysts. Responsibilities … Data Pipelines 🔗 Data Integration 🗄️ Databases 🤝 Collaboration 🔄 Automation 🔐 Security What we would love to see from you! 🎓 Education : Master’s in CS, Engineering, Mathematics, or related field 📊 Experience : Proven Data Engineer experience, preferably in finance 💻 Skills : Python, SQL, NoSQL, big data tools Cloud platforms (AWS, Azure more »

GCP Data Engineer Remote, but UK based up to £600pd - Outside IR35 I'm working with a great organisation to source a GCP Data Engineer for a new project. Your Knowledge & Experience 5+ years experience in Data Engineering/Architecture (or similar). Broad knowledge … of different technical areas (DevOps, Engineering, Architecture, Various Datastores, etc). Strong proficiency in SQL & Python . Experience working with Spark (Pyspark) , data streaming, and big data solutions. Experience with Databricks would be great. Designing and building data warehouses & data lakes in BigQuery, including data modeling and mapping using techniques such as medallion and star schema. Data pipeline/ETL Development , building ingestion pipelines that produce scalable data products as outputs for analytics. Orchestration frameworks such as Dataform , Airflow, and GCP Workflows. Cloud platforms , especially GCP services such as GCS, Cloud Functions more »

Job Description This role will drive the maturity of Rotork's Business Intelligence function by leading the efficient and reliable flow of data within the organisation. Sitting within the Development Team, the Senior Data Engineer will own the design, development, and management of the systems for collecting … storing, and analysing large volumes of data. They will take responsibility for creating data pipelines, optimising databases, implementing ETL processes, and ensuring data quality and governance. The Senior Data Engineer will have skills predominately in Azure - with a solid background in on premises, before more recent … exposure to cloud, and they will be confident in collaborating with cross functional teams to understand data requirements to be able to deliver solutions that meet business needs. This role would suit a technical expert ready to bring ideas to the table and help shape the future of BI more »