51 to 75 of 494 Data Engineer Jobs

Data Engineer Location: London, 3 days per week in the office Salary range: £50,000-£70,000 + benefits Purpose: Design, build, and maintain scalable data architectures, including pipelines and cloud-based data warehouses. Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or GCP), Snowflake … specialist consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing IT … services to the Maritime industry and are looking to provide its Data Insights services to key business partners who require Data Engineering expertise to support data management activities. The Role: The successful candidate will work on all aspects of our client's data architecture, collection, pipelining more »

Data Engineering Lead Do you enjoy leading a team that develops high-quality code? Are you A highly visible champion with a ‘can do’ attitude and enthusiasm that inspires others? About the Business LexisNexis Risk Solutions provides customers with solutions and decision tools that combine public and industry specific … content with advanced technology and analytics to assist them in evaluating and predicting risk and enhancing operational efficiency. We use the power of data and advanced analytics to help our customers make better, timelier decisions. By bringing clarity to information, we ultimately help make communities safer, insurance rates more … You can learn more about LexisNexis Risk solutions at the link below, https://risk.lexisnexis.com/. About our Team As a Lead Data Engineer you will be leading and liaising with dynamic, passionate across functional teams, where collaboration as a team is key. About the Role more »

maintaining business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how it … can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements … and priorities As part of the BI team you will be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the more »

Lead Data Engineer Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting learning and diversity at all … levels. They have a new opportunity for a Lead Data Engineer – this function is still relatively young in this region, and they’re looking for a thought leader in the industry to come in to this blank page and help write a new story. The person Experienced in … designing and deploying production data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Experience of leading teams, mentoring junior team members and promoting more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to … start interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If more »

Senior Azure Data Engineering Consultant Home-based with occasional customer travel £65,000 - £85,000 + bonus and benefits I'm working with a leading Microsoft Gold Partner who specialise in data. They are true experts when it comes to data strategy, data platforming, analytics, artificial intelligence … and data managed service. This means they are working on the most interesting and cutting-edge data centric projects in the market today. I’m looking for a Senior Data Engineering Consultant to join the team. This is an excellent opportunity for a Data Engineer, with experience in consulting and customer-facing roles to join a data-centric organisation at an exciting time of change. You will be well supported with the opportunity to gain numerous Microsoft certifications and accreditations to enhance your profile whilst working alongside experienced professionals to boost your learning more »

Geospatial Data Engineer | London (Remote) | £55,000-£65,000 🌍 Peaple Talent have partnered with a fast-growing, FinTech organisation, leading the market in technological innovation. They enable the world’s largest Asset Managers to understand the impacts that their portfolio companies have upon the natural world. My client … capture and process vast riches of environmental data, transforming raw information into actionable insights. From tracking deforestation trends in the Amazon rainforest to monitoring carbon emissions across urban landscapes. As part of this journey, we are looking for a talent Geospatial Data Engineer to join the growing … team who will specialise in Geospatial Data & GCP. What we are looking for: -Proven experience in data engineering role with a focus on geospatial data -Proficiency in programming languages such as Python and SQL. -Experience building ETL pipelines -Working knowledge of Google Cloud Platform What's in more »

Intelligence technologies and leading and educating a technical team across two global territories. The client is in the initial stages of deploying the Collibra Data Catalog tool to assist in accurate reporting of IT Asset Management. Collaborate with key stakeholders to understand business requirements and translate them into Collibra … solutions. Lead the implementation of Collibra Data Catalog, including configuration, customisation, and integration with other systems. Design and implement data governance workflows, data dictionaries, and data lineage within Collibra. Develop and maintain Collibra data governance policies, standards, and rules. Provide technical guidance and support to … users on Collibra platform usage and best practices. Develop custom reports and dashboards to monitor data governance metrics and KPIs. Conduct training sessions and workshops for end-users to promote adoption and usage of Collibra. Work closely with the Collibra vendor and internal IT teams to resolve technical issues more »

role, work together to minimise risk and shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. ROLE: Data Engineer LOCATION: Remote (UK) CLEARANCE: SC eligible Job Description: We are seeking a highly skilled Data Engineer to join our team. … the needs of our clients. Key Responsibilities: Consultant needs to be able to programme in Java as the project uses Java to ingest the data into the platform. The Consultant would be helping to build out the Data Lake and Lakehouse on Databricks, working with AWS. Stack: AWS … ECS, KMS, SNS, SQS, Lambda, Python, Databricks, MongoDB, Spring Boot AWS, Java (to support ingestion), Databricks - experience in PowerBi would also be useful. Engineer with past experience with Java, Data, and Infrastructure (DevOps). Java is a key skill Programming: Java, Python, PySpark Storage Mechanisms: MongoDB, Redshift, AWS more »

Are you passionate about leveraging data to drive meaningful impact? Do you thrive in a collaborative environment, eager to tackle complex challenges alongside talented teams? If so, we have an exciting opportunity for you! As a Senior Data Engineer at CleeAI, you'll be at the forefront … of transforming raw data into actionable insights that power our decision-making processes and enhance user experiences. Collaborating closely with Software Engineers, Data Scientists, and Product Managers, you'll play a pivotal role in optimizing growth strategies and refining our products for our extensive user base. In this … chance to work with cutting-edge technologies and methodologies, all while contributing to a culture of innovation and excellence. Whether it's architecting robust data pipelines, optimizing data storage and retrieval systems, or implementing scalable solutions, your expertise will directly impact our company's success and our users more »

with people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to do … challenges which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering … with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps culture. You’ll more »

with people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to do … challenges which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering … with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps culture. You’ll more »

Role: Senior Data Engineer Location: UK (Remote-first with monthly travel to London required) Recently listed as a "RegTech Top Performer" in Market Fintech's RegTech Supplier Performance Report, CUBE is pioneering the development of machine automated compliance. We are a global RegTech business defining and implementing the … and change for the financial services industry. We deliver our services through a SaaS platform, powered by an innovative combination of AI and proprietary data ontology, to simplify the complex and everchanging world of compliance for our clients. At CUBE, we are creating the future and are a company … structural detection, classification, entity extraction, summarisation, and recommendations. Available to customers and partners as APIs and via a UI. Role mission: Establish a strong data architecture in GCP for the backend of AI/ML/DS Services supporting a SaaS product. Build cost-efficient, low latency data more »

Lead Data Engineer – Blockchain Remote across Europe, hybrid options – London office Up to £120k Lead the charge as a Data Engineer in the Blockchain realm! This role offers remote opportunities across Europe, with hybrid options available in our London office. Earn up to £120k while making … a meaningful impact in the Web3 infrastructure. Our mission? To introduce unprecedented transparency and depth to Web3 infrastructure data, reshaping interactions with blockchain technologies worldwide. As a key player in our team, you'll craft and maintain robust data pipelines and APIs, facilitating seamless connections across our systems. … Your mastery of Python and SQL will be pivotal in handling and analyzing vast data volumes. Requirements: Proficient Python skills, ideally showcased through an active GitHub profile. Previous experience in Web3 is essential, you have to have worked in a Web3 company before to be considered. STEM degree from more »

Data Engineer Salary: National £28,000 – £43,000. London £30,000 - £50,000. An exciting opportunity exists to join our Data Engineering service team for a highly skilled individual to work within our Oracle Cloud environment, which is helping to shape the future of insurance through cutting … edge data delivery to predictive analytics, data science and underwriting. The team is part of Aviva’s global Data Science Practise (Quantum) and is recognised as a centre of excellence - providing an Oracle Cloud platform that delivers the data needed to drive improved decision-making and … technical knowledge including SQL, along with an understanding of insurance, an interest in analytics, good communication and stakeholder management skills, and an interest in data pipelines. A bit about the job: This is a key role within the development and maintenance of various data delivery applications, from design more »

This innovative Multi-Strategy Hedge Fund, seek an experienced Software Engineer with expertise in Python to work within a dynamic Data Engineering Group building greenfield pipelines, frameworks, APIs and core Data store (Data warehouse and Data Lake) to enable the ingestion and provision (upstream and … Trading teams firmwide (X-Asset - Equities, Rates, Commodities, FX and Crypto). Key Skills required 3+ years of exp. as a Software Developer/Data Engineer with Python as your core language Extensive API and Microservices development experience 3+ years SQL Strong DB skills ideally in both SQL more »

Data Maintenance Engineer On site 5 days/Shift pattern £30,000 - £35,000 Capgemini are looking to recruit a Technical Lead with A400M Flight Data experience, to join our team base din Brize Norton. Data Analysis We are looking to recruit Aircraft Maintenance Data … the UK-based A400M aircraft fleet at RAF Brize Norton. The role will concern the upload/creation of material parts in the appropriate data base for ensuring better control and link between the maintenance activities and spare parts use during the completion of the maintenance work. Responsibilities: To … support the Customer with all topics related to maintenance data management and technical support, to support the ongoing operations of the UK-based A400M fleet. This role is based at RAF Brize Norton, Oxfordshire. Responsibilities will include: • A one off activity will be required at the beginning of the more »

Principal Configuration & Data Management Engineer Location: Preston Job type: Permanent Salary: Competitive Delkia is a specialist Systems Integrator operating throughout the UK and Internationally for safety-related and mission-critical systems in highly regulated sectors, including Aerospace, Maritime, Defence and Clean Energy. Our offering includes system integration, engineering … are harnessed specifically for each project’s needs, maturity and technology requirements. We have an exciting opportunity to appoint an experienced Principal Safety Capability Engineer to join our dynamic team at Delkia. Overview of the role We are seeking an experienced engineer in configuration and data management … across sectors and products through life. This includes core CM functions of planning, identification, change, status accounting & verification and audit as well the associated data management experience in supplier data requirements, data stewardship, data modelling & data exchange. Knowledge of CDM Management Systems with a strong more »

with options for remote or hybrid working. Our client, a global leader in IT solutions for buses and trains, is seeking a highly skilled Data Engineer with a focus on ETL processes to join their expanding team. This role offers the opportunity to contribute significantly to making public … By joining this team, you will be at the forefront of enhancing mobility for millions of system users and passengers globally. The Role: The Data Engineer will be responsible for designing, building, and maintaining sophisticated ETL pipelines and data integrations that support crucial analytics and business intelligence … a dynamic environment where your work directly impacts the effectiveness and efficiency of public transport systems. Responsibilities Include: Develop and manage ETL processes, integrating data from diverse sources into a unified data warehouse. Utilise Python and other advanced tools to script and automate data processes. Create and more »

Data Engineer Azure/Snowflake/Power Bi/Airflow London (Contract) Role: Our client is looking to expand their data engineering team and add in the utilisation of Snowflake which is currently being used by a select few members of the team, and upskilling taking place … alongside. They want to add in an additional team member who has multiple years of experience using Snowflake as a data tool and can hit the ground running Experience Snowflake Financial services Cloud (Ideally azure) Airflow would be an advantage more »

An exciting new opportunity has become available for a Data & Reporting Engineer, with experience with Snowflake or similar data warehouse, Power BI Reporting and Data Modelling. The primary focus of this role will be the development of a Snowflake data warehouse environment and will include … using ETL tools, DBT and Power BI for reporting and data visualisations. As the ideal candidate you will be adept at working with large data sets to develop advanced, scalable Data Warehouse solutions from end-to-end. The client is still at the early stages of building … a Cloud based Data Warehouse based on Snowflake hosted on MS Azure. The basic architecture has been established and various system components talk to each other but there is still a lot to do and this will be a huge opportunity for the right person to take ownership of more »

Would you be interested in a data engineering role at a fast-paced AI (LLM) start-up comprised of Meta, Google, AWS, and Microsoft alumni? You can expect to: Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Design robust … data processing and indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness. Ensure the secure handling of data through end-to-end encryption, data isolation, and other best practices. Manage cloud orchestration and data infrastructure, applying your expertise with various … data processing and indexing tools to ensure scalability and reliability. Work closely with the team to integrate search infrastructure that meets the needs of large language models and retrieval systems. Your first 3 months will include: You have a strong grasp infrastructure, architecture, performance concerns, SDLC and practices. You more »

Data Engineer My client has experience working with high-level security and providing infrastructure for mission critical environments, as well as large scale public events. Due to a recent expansion, my client is looking for a Data Cabling Engineer to join their team. Job Specification Location … Company van & Fuel Card Annual Tools Allowance Company Mobile Company Credit Card Company Screwfix Card Paid Travel Holiday Buy & Sell Scheme Responsibilities: voice and data installations including 1st and 2nd fixing cabling throughout a range of sites. across established and new sites of containments of fibre cable and maintaining … and PASMA Be willing to travel within the UK and complete some out of hours work Essential Requirements Full UK Driver’s License Previous Data Cabling Experience, including testing and using fluke test equipment Experience in installation comms and cabinets Experience with fault finding and rectifying. Be able to more »

of the emerging blockchain financial markets. They have launched one of the largest by % block-builders on Ethereum. They are now looking for a Data Engineer to join their growing team. W e are looking for someone with the following: Strong programming skills in Python (2-3+ … years expertise) Experience working with SQL and No SQL Knowledge of Data Management, Data Warehousing concepts and methodologies Comfortable working with Linux, AWS, Git, Docker is a big plus Experience working in (whether professionally or as a side project) and having a passion for crypto, blockchain and MEV more »

Lead Data Engineer with Palantir Foundry Remote Contract NOTE:- The Consultant Needs to work In Europe Time Zone Description: Total experience of 7+ years in Data Engineering and must have at least 3 years of experience in Palantir Foundry. Strong experience with Palantir Data Engineering features … such as, Code Repo, Code Workbook, Pipeline Build, migration techniques, Data Connection and Security setup. Design, develop Data Pipelines, and have excellent skills in PySpark and Spark SQL, hands on with code Build and deployment in Palantir. Must lead a team of 6-7 technical associates with PySpark more »