101 to 125 of 375 Data Pipeline Jobs in the UK

Job Title: Gen AI Consultant Location: Fully Remote Job Type: Contract/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and reliable data infrastructure. Develop and maintain databases, ensuring data quality, integrity, and security. AI Integration in Healthcare: Assist in the development and implementation of AI solutions tailored to healthcare challenges. Collaborate with data scientists … and machine learning engineers to deploy models into production environments. Utilize genomics, clinical, and administrative data to derive actionable insights and recommendations. Research and Innovation: Stay abreast of the latest advancements in genomics, healthcare, and AI technologies. Contribute to the development of new methodologies and tools to enhance more »

Principal GCP Data Engineer Remote Up to £85,000 VIQU are seeking Principal GCP Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a … numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal GCP Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … include data ingestion, quality, modelling, transformation, security, and monitoring. The Principal GCP Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and more »

already hold active DV or SC clearance to be considered for this position. Role Outline: Assist with the continued development and maintenance of data pipelines using NiFi and signature updates using Elastic/Kibana . System administration on specific cyber defence applications and systems to include installation, configuration more »

Senior Data Analyst up to £70,000 London (3 days p/w minimum) I'm partnered with a client who are looking for a Senior Data Analyst to drive their analytical capability, this is an exciting greenfield role with lots of scope to add real … value. There is endless opportunity in this role to have real commercial impact using the power of Data Analytics. You will play a role in the data collection, managing what comes out of data pipelines, and you also work to drive their strategic projects. … The Data team is still quite small, so they're looking for this person to really drive analytics capability forward. You'll have the opportunity to design new product proposals and design and launch new digital products. From a tech tool point of view, they are quite agnostic more »

Referment are working closely with the Investment Team for a global Multi-Strategy Hedge Fund to help hire a Weather Data Scientist for their London team. Their commodities division has been going from strength to strength and with their innovative weather research and forecasting platform, they’re looking … for a skilled Weather Data Scientist to work on PM engagement in advising how these analytics can be applied to trading within the Commodities Markets. This is an individual contributor role and will require someone who can work closely with portfolio managers covering weather analytics focusing on temperature … precipitation, and wind patterns impact on the commodity markets. You will work closely with data engineers focusing on the analytics and modelling side of the platform being built. Statistical analysis, weather mapping and visualisation reports will be required to show the impact of the prices on the commodities more »

Here at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced Data Engineer to join a multi-disciplinary team building, supporting and maintaining User-Centred digital solutions that offer real value and work for everyone. Key Responsibilities: Act as … is also desirable. Solid experience of at least one Cloud provider such as AWS, Azure or GCP. Strong experience of working with different data formats, e.g., CSV, JSON and XML Building reliable Data Pipelines Working in an Agile Environment Test-Driven Development and/or Behaviour more »

Partnered with a global fintech firm, in the prime brokerage space, that are looking for a skilled SWE (data focused) to join their London office as part of their core ledger & populator team, ensuring connectivity is in place to move/ingest large amounts of (market) data and systems in place to move money. Responsibilities: Build connectivity to facilitate the ingestion of market data and trading activities from both traditional and digital exchanges. Develop data pipelines for transferring large volumes of data, enabling real-time analysis. Build systems to … nice to have) Prior experience working with a mid-early stage fintech start up (nice to have) Experience with standard tooling for big data (nice to have) Experience in cryptocurrency (nice to have) This is a great opportunity to join a fast pace growing company with good funding more »

London & Edinburgh Work Mode: Mostly WFH, candidates should be open to travel as required. Job Description: We are seeking a highly skilled Senior Data Engineer with expertise in SAS to join our team and contribute to the transformation of our data pipelines. The successful candidate will … play a crucial role in rewriting existing pipelines from SAS, Info, pearl, and shell scripts to Python and DBT-based solutions, ultimately loading data into Snowflake and Salesforce on Azure. Key Responsibilities: Lead the conversion of existing SAS-based modules to Python-based solutions. Design, develop, and implement … Python and DBT-based pipelines for efficient data transformation and loading. Collaborate with cross-functional teams to understand requirements and ensure successful pipeline migration. Utilize expertise in SAS, pearl, and shell scripts to seamlessly transition to Python and DBT technologies. Implement best practices for data more »

AI solutions that enhance, organise, and enrich their data, cost-effectively, accurately, and scalably Plan and manage their ML/AI delivery pipeline Mentor and coach team members on ML engineering best practices Advise senior management on their ML/AI strategy. Key skills: Python for Machine … Learning and Data Science Computer Vision Frameworks used in Machine Learning and Data Science such as TensorFlow, PyTorch, and scikit-learn. Data Science and Visualisation libraries including Pandas, NumPy, scikit-learn, matplotlib, Seaborn. Cloud services used in machine learning and data science … such as Azure, OpenAI, Hugging Face, AWS ML/AI. Machine Learning Applications development life cycle processes and tools - MLOps, including building ETL data pipelines. Cutting-edge approaches to Machine Learning, including transformer models, diffusion models, and adversarial machine learning. Experience in fine-tuning off-the-shelf Large more »

Our client are a renowned name in the Property Sector, they are on the lookout for 2 AWS Data Engineers to come in on a contract basis. Key Skills/Requirements: Must have Python & Spark experience Must have strong AWS experience Must have Terraform experience SQL & NoSQL experience … Have built out Data Warehouses & built Data Pipelines Strong Databricks & Snowflake experience Docker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to have Contracts are running for 6 months initially, paying up to £450p/day (Outside IR35) and will be mostly remote more »

Brio Digital are happy to be supporting a data consultancy who are currently looking for an analytics engineer. The role will be hybrid with 3x days per week on-site in London. Salary; Up-to £80,000. Analytics Engineer Experience & Tech; SQL Python Experience with cloud platforms such … as GCP or Azure. Experience with Big Query & Synapse. Experience with Data visualisation tools such as D3. Experience in a client facing position A consultancy background would be highly beneficial. Analytics Engineer role overview; You have previously had experience working across multiple client projects at one time. You … be very client facing & also present to clients so if you have done this previously, that will be highly beneficial. You will build data pipelines to support analytics across very large data sets. You will mentor and support more junior members of the team. Apply now more »

Fantastic new opportunity for a Data Engineer to join a high performing team at a leading hedge fund! You'll be vital in building and maintaining infrastructure for the efficient execution of their quantitative and discretionary trading strategies. What we'd love to see: MSc in Comp Sci … Engineering etc. from a Top University Demonstrable Data Engineering experience within a financial services company or hedge fund/commodity trading Strong Python and SQL Building and maintaining data pipelines AWS preferred but not essential What's in it for you? £80k - £100k starting salary dependent … on experience Opportunity to work with a world class team of Data professionals and portfolio managers 4 days on site more »

Test Engineer Contract Type: Inside IR35 Rate: £500 per day Duration: 6 months This is a highly back-end/data-focused testing position, so experience in this area is essential. Location: Remote with travel to Leeds or London as required Brio is working with a leading provider … Requirements:** Proven experience as an Automation Test Analyst, preferably within the healthcare or NHS sector. Strong scripting skills in SQL and Python ETL, Data Migrations, Data Pipelines Experience with test automation frameworks. AWS cloud Excellent communication and collaboration skills. Ability to work effectively in a fast more »

based projects, alongside deep learning and neural networks to support core clients Part of a team of 12 reporting to the Head of Data Science Chance to have 1 direct report within an MLE team of 3 Focusing on end-to-end data pipelines, for training … evaluating and deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Driving best practices in a fast paced environment, within a well established company Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong experience more »

teams, to promote the implementation of sophisticated tools/analytics and advance their risk/pricing workflow. Devote special attention towards building robust data pipelines. Develop new innovative models, as well as enhancing existing ones. Implement and enhance existing data pipelines required by our various models … in Math, Sciences, Engineering or Computer Science; Software design and development skills, particularly in Python or C++; Experience with complex/real-time data pipes; Significant work experience in a related field; Analytical, quantitative and problem-solving skills; Excellent communication and presentation skills, in particular to senior stakeholders more »

Converted code is causing failures/performance issues. Your responsibilities; As a Spark Scala Engineer you will be working for the GDT (Global Data Technology) Team, you will be responsible for: Designing, building, and maintaining data pipelines using Apache Spark and Scala Working on an Enterprise … Cloud Services in one of the Clouds (GCP). Mandatory Skills; At least 8+ Years of IT Experience with designing, building, and maintaining data pipelines . At least 4+ Years of experience with designing, building, and maintaining data pipelines using Apache Spark and Scala. Programming languages … Proficiency in Scala and Spark is essential. Familiarity with Python and SQL is often a plus. Big Data technologies: Understanding of HDFS,... more »

trusted partner, a leading financial services provider is currently hiring an Lead Azure DevOps Engineer who has recent experience working alongside a large data infrastructure department implementing CI/CD pipelines within an Azure environment our client transitions their legacy IT estate into the cloud. This is an … be able to demonstrate strong capabilities in Azure DevOps methodologies with the ability to implement CI/CD pipelines in collaboration with the data engineering team. Core responsibilities: Lead the implementation and maintenance of CI/CD pipelines for data projects, ensuring efficiency and scalability. Collaborate … for process improvement and implement solutions to streamline development workflows. Monitor system performance and implement optimizations to ensure the reliability and availability of data pipelines and services. Collaborate with cross-functional teams to troubleshoot issues, implement fixes, and ensure timely resolution of technical challenges. Stay up-to-date more »

Push the boundaries of BI, building complex data pipelines and beautiful visualisations for all kinds of business users at this $50bn Hedge Fund. Every business user here understands the power and importance of data for them to do their jobs and for the business to excel. … t need to understand what a Hedge Fund does, but you’ll need to be adaptable and eager to learn. You’ll take data requirements direct from the business users and you’ll be given freedom and support to come up with your own ideas to give the … with modern tech such as Snowflake, Airflow, DBT, Kubernetes/Docker and cubeJS whilst also using Tableau CRM and Jupyter notebooks for gaining data insights. If you think there’s a better or newer tool, you’re free to use that too. The key think is that you more »

ll play a key role building a Gen AI system that facilitates seamless communication between users and databases, enhancing efficiency and accuracy in data retrieval and analysis. Responsibilities include: Lead the development of systems with a specific emphasis on AI/ML applications, CI/CD pipelines, APIs … and communication layers across hybrid architectures spanning multiple public clouds and private data centers. Engineer global-scale backends using microservices or distributed systems, primarily in Python (experience in other languages is advantageous). Collaborate on PDF parsing and/or optical character recognition (OCR) projects. Construct data more »

InstaDeep is looking for an Applied Research Scientist to join our expanding team. Applied Research Scientists at InstaDeep develop algorithms and data pipelines focused mainly, but not exclusively, on physics-based methods. As part of the BioAI team, you will be contributing to the development of new approaches … Keywords: Computational molecular Physics, Structural Biology, Computational Chemistry, Protein Interactions, Protein Design, Molecular Dynamics, Monte Carlo, Enhanced Sampling, Machine Learning, Deep Learning, Statistics, Data Science Responsibilities Design, implement and deliver complex pieces of research in the area of computational molecular physics/biology. Implement and test pioneering enhanced more »

I'm looking for a Power BI and data analytics enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be … aligned to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying … data sources, implementing data capture and storage methodologies, and automating data pipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve more »

I'm looking for a Power BI and data analytics enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be … aligned to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying … data sources, implementing data capture and storage methodologies, and automating data pipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve more »

I'm looking for a Data Engineer with experience working across SQL Server, Python, and ideally some Azure services to join a London-based events organisation. This is a hybrid role, requiring 2 days in the office and 3 days at home per week. You will be joining … their growing Data and Analytics team, who have been re-building and enhancing their Customer Data Platform in partnership with a well-renowned tech consultancy, to deliver better value and insights to various internal teams such as Commercial, Marketing, Digital etc. To do this, you will … leverage SQL, Python, Azure Cloud Services (e.g. Azure Data Factory) and Snowflake (though please note that prior experience with Snowflake is not a requirement). Their front-end reporting is in Power BI, which you may also have the opportunity to get involved in, though this is not more »

I'm looking for a Data Engineer with experience working across SQL Server, Python, and ideally some Azure services to join a London-based events organisation. This is a hybrid role, requiring 2 days in the office and 3 days at home per week. You will be joining … their growing Data and Analytics team, who have been re-building and enhancing their Customer Data Platform in partnership with a well-renowned tech consultancy, to deliver better value and insights to various internal teams such as Commercial, Marketing, Digital etc. To do this, you will … leverage SQL, Python, Azure Cloud Services (e.g. Azure Data Factory) and Snowflake (though please note that prior experience with Snowflake is not a requirement). Their front-end reporting is in Power BI, which you may also have the opportunity to get involved in, though this is not more »

I'm looking for a Data Engineer with experience working across SQL Server, Python, and ideally some Azure services to join a London-based events organisation. This is a hybrid role, requiring 2 days in the office and 3 days at home per week. You will be joining … their growing Data and Analytics team, who have been re-building and enhancing their Customer Data Platform in partnership with a well-renowned tech consultancy, to deliver better value and insights to various internal teams such as Commercial, Marketing, Digital etc. To do this, you will … leverage SQL, Python, Azure Cloud Services (e.g. Azure Data Factory) and Snowflake (though please note that prior experience with Snowflake is not a requirement). Their front-end reporting is in Power BI, which you may also have the opportunity to get involved in, though this is not more »