76 to 100 of 398 Data Pipeline Jobs in the UK

DATA ENGINEER LONDON BASED £75,000-95,000 PER ANNUM This growing e-commerce trading company are searching for a new Data Engineer. You will be responsible for building and maintaining a new AWS serverless platform. You will also be responsible for building and maintaining data pipelines, using Python. THE COMPANY This E-commerce trading company have been growing since their formation. They are expanding their Data and Analytics team as the CEO has realised how important Data and Technology are to the business and is investing further in Machine … Learning variables. THE ROLE You will be joining an expanding Data and Analytics team, which currently has more than 20 employees. You will be responsible for building and maintaining a new AWS serverless data platform. Improve best coding practices within the Business. Stream real-time Data more »

Data Engineer On-Premise/Excel/SQL We have partnered with a leading client based in Central London who are looking to increase their data engineering team. Role: You will be working on a large volume of various financial reporting data sources. The … client here is using on-premise databases including Excel services & SQL. You will be working to gather data from these various sources for reporting, and creating the data pipelines. Experience: Data engineering experience within financial services (Asset Management/Harrington Starr) Experience working to … gather data from on-premise sources such as Excel, SQL and Oracle. If this is of interest please reach out. archie.odonovan@harringtonstarr.com more »

and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in … collaboration while inclusivity strengthens our community. As part of our team, you'll be tasked with: Here at Ascent, we believe that using data in the right way doesn't just help companies perform better; it transforms entire industries. You'll help world-leading brands transform the way more »

Job Title: Gen AI Consultant Location: Fully Remote Job Type: Contract/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and reliable data infrastructure. Develop and maintain databases, ensuring data quality, integrity, and security. AI Integration in Healthcare: Assist in the development and implementation of AI solutions tailored to healthcare challenges. Collaborate with data scientists … and machine learning engineers to deploy models into production environments. Utilize genomics, clinical, and administrative data to derive actionable insights and recommendations. Research and Innovation: Stay abreast of the latest advancements in genomics, healthcare, and AI technologies. Contribute to the development of new methodologies and tools to enhance more »

crypto technology company that specialise in building trading and MEV-related infrastructure and services, based in London. They are looking to add a data engineer to their tech function. Background in or strong understanding of Crypto and/or the Miner Extractable Value (MEV) is needed - please only … apply if you have good knowledge of the space. The team are focusing on designing, building, and optimizing their data infrastructure. Previous experience in low latency systems, algorithmic trading, or MEV-related systems is a plus but not required. Responsibilities: Oversee the complete process of gathering and analyzing … telemetry data to derive insights regarding company performance Support the development team in resolving issues by using data gathered from various sources Designing, developing, and maintaining scalable and reliable data pipelines and ETL processes Building and managing data monitoring tools to ensure more »

Senior Data Analyst up to £70,000 London (3 days p/w minimum) I'm partnered with a client who are looking for a Senior Data Analyst to drive their analytical capability, this is an exciting greenfield role with lots of scope to add real … value. There is endless opportunity in this role to have real commercial impact using the power of Data Analytics. You will play a role in the data collection, managing what comes out of data pipelines, and you also work to drive their strategic projects. … The Data team is still quite small, so they're looking for this person to really drive analytics capability forward. You'll have the opportunity to design new product proposals and design and launch new digital products. From a tech tool point of view, they are quite agnostic more »

Referment are working closely with the Investment Team for a global Multi-Strategy Hedge Fund to help hire a Weather Data Scientist for their London team. Their commodities division has been going from strength to strength and with their innovative weather research and forecasting platform, they’re looking … for a skilled Weather Data Scientist to work on PM engagement in advising how these analytics can be applied to trading within the Commodities Markets. This is an individual contributor role and will require someone who can work closely with portfolio managers covering weather analytics focusing on temperature … precipitation, and wind patterns impact on the commodity markets. You will work closely with data engineers focusing on the analytics and modelling side of the platform being built. Statistical analysis, weather mapping and visualisation reports will be required to show the impact of the prices on the commodities more »

Software Engineer– LondonSports Analytics & Statistics CompanyFulltime onsite*Please note this role cannot sponsor. Please do not apply if you are seeking sponsorship*A Data Engineer is required for an exciting and innovative Software sports betting company based in London. The successful candidates will be working closely with the … researchers and alongside other extremely talented and driven engineers to build and support systematic trading models. You will be working on real-time data pipelines for live sports events where your expertise will help the company advance their in-play sports analytics and pricing function. Your day-to … day will involve developing robust and scalable data pipelines, implementing new feeds into the business, and integrating them with their quantitative decision models.Essential SkillsProven experience as a data engineer or similar, with a track record of handling mid to large scale data projects.Strong proficiency more »

Here at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced Data Engineer to join a multi-disciplinary team building, supporting and maintaining User-Centred digital solutions that offer real value and work for everyone. Key Responsibilities: Act as … is also desirable. Solid experience of at least one Cloud provider such as AWS, Azure or GCP. Strong experience of working with different data formats, e.g., CSV, JSON and XML Building reliable Data Pipelines Working in an Agile Environment Test-Driven Development and/or Behaviour more »

Partnered with a global fintech firm, in the prime brokerage space, that are looking for a skilled SWE (data focused) to join their London office as part of their core ledger & populator team, ensuring connectivity is in place to move/ingest large amounts of (market) data and systems in place to move money. Responsibilities: Build connectivity to facilitate the ingestion of market data and trading activities from both traditional and digital exchanges. Develop data pipelines for transferring large volumes of data, enabling real-time analysis. Build systems to … nice to have) Prior experience working with a mid-early stage fintech start up (nice to have) Experience with standard tooling for big data (nice to have) Experience in cryptocurrency (nice to have) This is a great opportunity to join a fast pace growing company with good funding more »

London & Edinburgh Work Mode: Mostly WFH, candidates should be open to travel as required. Job Description: We are seeking a highly skilled Senior Data Engineer with expertise in SAS to join our team and contribute to the transformation of our data pipelines. The successful candidate will … play a crucial role in rewriting existing pipelines from SAS, Info, pearl, and shell scripts to Python and DBT-based solutions, ultimately loading data into Snowflake and Salesforce on Azure. Key Responsibilities: Lead the conversion of existing SAS-based modules to Python-based solutions. Design, develop, and implement … Python and DBT-based pipelines for efficient data transformation and loading. Collaborate with cross-functional teams to understand requirements and ensure successful pipeline migration. Utilize expertise in SAS, pearl, and shell scripts to seamlessly transition to Python and DBT technologies. Implement best practices for data more »

AI solutions that enhance, organise, and enrich their data, cost-effectively, accurately, and scalably Plan and manage their ML/AI delivery pipeline Mentor and coach team members on ML engineering best practices Advise senior management on their ML/AI strategy. Key skills: Python for Machine … Learning and Data Science Computer Vision Frameworks used in Machine Learning and Data Science such as TensorFlow, PyTorch, and scikit-learn. Data Science and Visualisation libraries including Pandas, NumPy, scikit-learn, matplotlib, Seaborn. Cloud services used in machine learning and data science … such as Azure, OpenAI, Hugging Face, AWS ML/AI. Machine Learning Applications development life cycle processes and tools - MLOps, including building ETL data pipelines. Cutting-edge approaches to Machine Learning, including transformer models, diffusion models, and adversarial machine learning. Experience in fine-tuning off-the-shelf Large more »

Our client are a renowned name in the Property Sector, they are on the lookout for 2 AWS Data Engineers to come in on a contract basis. Key Skills/Requirements: Must have Python & Spark experience Must have strong AWS experience Must have Terraform experience SQL & NoSQL experience … Have built out Data Warehouses & built Data Pipelines Strong Databricks & Snowflake experience Docker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to have Contracts are running for 6 months initially, paying up to £450p/day (Outside IR35) and will be mostly remote more »

Brio Digital are happy to be supporting a data consultancy who are currently looking for an analytics engineer. The role will be hybrid with 3x days per week on-site in London. Salary; Up-to £80,000. Analytics Engineer Experience & Tech; SQL Python Experience with cloud platforms such … as GCP or Azure. Experience with Big Query & Synapse. Experience with Data visualisation tools such as D3. Experience in a client facing position A consultancy background would be highly beneficial. Analytics Engineer role overview; You have previously had experience working across multiple client projects at one time. You … be very client facing & also present to clients so if you have done this previously, that will be highly beneficial. You will build data pipelines to support analytics across very large data sets. You will mentor and support more junior members of the team. Apply now more »

Fantastic new opportunity for a Data Engineer to join a high performing team at a leading hedge fund! You'll be vital in building and maintaining infrastructure for the efficient execution of their quantitative and discretionary trading strategies. What we'd love to see: MSc in Comp Sci … Engineering etc. from a Top University Demonstrable Data Engineering experience within a financial services company or hedge fund/commodity trading Strong Python and SQL Building and maintaining data pipelines AWS preferred but not essential What's in it for you? £80k - £100k starting salary dependent … on experience Opportunity to work with a world class team of Data professionals and portfolio managers 4 days on site more »

Test Engineer Contract Type: Inside IR35 Rate: £500 per day Duration: 6 months This is a highly back-end/data-focused testing position, so experience in this area is essential. Location: Remote with travel to Leeds or London as required Brio is working with a leading provider … Requirements:** Proven experience as an Automation Test Analyst, preferably within the healthcare or NHS sector. Strong scripting skills in SQL and Python ETL, Data Migrations, Data Pipelines Experience with test automation frameworks. AWS cloud Excellent communication and collaboration skills. Ability to work effectively in a fast more »

with various jurisdictions. Implement scalable, supportable models for capital and liquidity management in collaboration with the Engineering team. Develop historical analysis and perform data research to back capital & liquidity models. Ensure balanced focus on internal management and external reporting for both capital and liquidity. Deploy production-grade code … and manage data pipelines as a full-time member of the Engineering team. Work closely with Risk, Structuring, Finance, and Compliance teams for regulatory interpretations, focusing equally on capital and liquidity management. Knowledge, Skills & Abilities Strong data science skills, particularly in Python and SQL, for data more »

based projects, alongside deep learning and neural networks to support core clients Part of a team of 12 reporting to the Head of Data Science Chance to have 1 direct report within an MLE team of 3 Focusing on end-to-end data pipelines, for training … evaluating and deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Driving best practices in a fast paced environment, within a well established company Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong experience more »

pandas, scikit-learn to name a few of the open-source libraries we use extensively. We implement the systems that require the highest data throughput in Java and C++.We use Airflow for workflow management, Kafka for data pipelines, Bitbucket for source control, Jenkins for continuous integration more »

teams, to promote the implementation of sophisticated tools/analytics and advance their risk/pricing workflow. Devote special attention towards building robust data pipelines. Develop new innovative models, as well as enhancing existing ones. Implement and enhance existing data pipelines required by our various models … in Math, Sciences, Engineering or Computer Science; Software design and development skills, particularly in Python or C++; Experience with complex/real-time data pipes; Significant work experience in a related field; Analytical, quantitative and problem-solving skills; Excellent communication and presentation skills, in particular to senior stakeholders more »

trusted partner, a leading financial services provider is currently hiring an Lead Azure DevOps Engineer who has recent experience working alongside a large data infrastructure department implementing CI/CD pipelines within an Azure environment our client transitions their legacy IT estate into the cloud. This is an … be able to demonstrate strong capabilities in Azure DevOps methodologies with the ability to implement CI/CD pipelines in collaboration with the data engineering team. Core responsibilities: Lead the implementation and maintenance of CI/CD pipelines for data projects, ensuring efficiency and scalability. Collaborate … for process improvement and implement solutions to streamline development workflows. Monitor system performance and implement optimizations to ensure the reliability and availability of data pipelines and services. Collaborate with cross-functional teams to troubleshoot issues, implement fixes, and ensure timely resolution of technical challenges. Stay up-to-date more »

Push the boundaries of BI, building complex data pipelines and beautiful visualisations for all kinds of business users at this $50bn Hedge Fund. Every business user here understands the power and importance of data for them to do their jobs and for the business to excel. … t need to understand what a Hedge Fund does, but you’ll need to be adaptable and eager to learn. You’ll take data requirements direct from the business users and you’ll be given freedom and support to come up with your own ideas to give the … with modern tech such as Snowflake, Airflow, DBT, Kubernetes/Docker and cubeJS whilst also using Tableau CRM and Jupyter notebooks for gaining data insights. If you think there’s a better or newer tool, you’re free to use that too. The key think is that you more »

ll play a key role building a Gen AI system that facilitates seamless communication between users and databases, enhancing efficiency and accuracy in data retrieval and analysis. Responsibilities include: Lead the development of systems with a specific emphasis on AI/ML applications, CI/CD pipelines, APIs … and communication layers across hybrid architectures spanning multiple public clouds and private data centers. Engineer global-scale backends using microservices or distributed systems, primarily in Python (experience in other languages is advantageous). Collaborate on PDF parsing and/or optical character recognition (OCR) projects. Construct data more »

and mapping technology. Key Responsibilities: Create and optimize front-end user interfaces for web and mobile platforms. Develop and enhance core algorithms and data pipelines using C++ and Python. Collaborate on both front-end and back-end development. Work with hardware platforms, including mobile robots and handheld devices … like lidar, vision, GPS, and IMUs. Understanding of modern algorithms for visual and laser odometry and reconstruction. Knowledge of perception pipelines involving 3D data such as point clouds and mesh reconstructions. Experience with AutoDesk’s Revit application in engineering design. Experience in developing Android applications. If you are more »

InstaDeep is looking for an Applied Research Scientist to join our expanding team. Applied Research Scientists at InstaDeep develop algorithms and data pipelines focused mainly, but not exclusively, on physics-based methods. As part of the BioAI team, you will be contributing to the development of new approaches … Keywords: Computational molecular Physics, Structural Biology, Computational Chemistry, Protein Interactions, Protein Design, Molecular Dynamics, Monte Carlo, Enhanced Sampling, Machine Learning, Deep Learning, Statistics, Data Science Responsibilities Design, implement and deliver complex pieces of research in the area of computational molecular physics/biology. Implement and test pioneering enhanced more »