76 to 100 of 107 Data Pipeline Jobs in Berkshire

end-to-end architecture of RMN platforms, covering sponsored ads, programmatic DSP, self-service portals, and dynamic ad placements. • Design scalable and modular RMN solutions, integrating Ad-Serving, Data Management Platforms (DMP), Customer Data Platforms (CDP), and Demand-Side Platforms (DSP). • Ensure real-time bidding (RTB) and programmatic advertising capabilities within the RMN ecosystem. • Develop … and automated campaign optimization. • Implement Generative AI for automated ad creation, content personalization, and A/B testing. • Enhance Dynamic Creative Optimization (DCO) capabilities for personalized ad experiences. Data & Integration Framework • Define data ingestion, processing, and activation strategies across first-party, second-party, and third-party data sources. • Ensure seamless API integrations with RMN … models to measure ad performance effectively. Ad-Tech Stack & Cloud Architecture • Design RMN solutions leveraging Google Cloud, AWS, or Azure, ensuring high availability and low-latency performance. • Optimize data pipelines, real-time analytics, and identity resolution mechanisms. • Oversee privacy-compliant data handling (GDPR, CCPA) and secure identity frameworks. Stakeholder Collaboration & Roadmap Execution • Work closely with engineering More ❯

customer-facing communication . ?️ What You’ll Work With: Backend and integration work with Python , Node.js , and TypeScript Front-end work using React Cloud infrastructure via AWS APIs, data pipelines, and custom tooling for real-world deployments Opportunity to work with ML/AI systems at the integration level (no prior ML required, but a plus) ? What They More ❯

Social network you want to login/join with: Investment Data Operations Analyst/Engineer - Major Hedge Fund – Lucrative Total Comp Package, Slough Client: Location: Slough, United Kingdom Job Category: Other - EU work permit required: Yes Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 Job Description: A high performing, multi-billion dollar AUM hedge fund is looking to … hire a Data Analyst into their rapidly growing centralized Data Management team. Reporting to the Global Head of Data and holding a highly visible role, the successful candidate will work closely with Operations … Product Control, Risk, Trading, and Research teams to ensure smooth data transmission. The role has a technical/engineering focus, involving the optimization of data pipeline operations and quality management, from raw data onboarding to delivery of data points to front office and investment teams. You will utilize your technical skills More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can transform enterprise operations? Do you possess strategic vision, technical expertise, and leadership skills to drive data-driven solutions? If so, you might be the ideal candidate for the Data and Analytics role within Mars's Global Pet … achieve growth, profitability, and customer centricity. This role requires demonstrating thought leadership, technical proficiency, and the ability to navigate complex challenges while leading a team of top-tier data and analytics professionals. The role involves transitioning to a product-based model to develop digital capabilities. Responsibilities include developing and maintaining robust data pipelines and storage solutions … to support analytics and machine learning initiatives. You will report to the Director of Data Engineering Solutions and collaborate globally with engineering teams across core products. Key Responsibilities: Technical Leadership: Provide leadership to data and DevOps engineers. Collaborate on designing and evolving scalable data platforms. Promote best practices and foster a high-performance culture. More ❯

Numi Location: Slough, United Kingdom Job Category: Other - EU work permit required: Yes Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 Job Description: Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland Numi is proud to partner with a leading data integration technology provider serving some of the biggest … clients in the industry! We are seeking experienced Lead Backend Engineers (PHP) to join either the Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimizing end-to-end platform journeys and creating impactful customer experiences, including developing data visualization dashboards and building features from scratch. The Data Warehousing team handles … data storage and transfer solutions, scaling and refactoring complex data transfer systems for large data volumes, and enhancing internal storage. As a Lead Backend Engineer, you will lead feature development, ensure high code quality, provide technical guidance, and collaborate with product managers, designers, and frontend engineers. You will identify system bottlenecks, improve monitoring, and More ❯

Social network you want to login/join with: Role: Senior Product Manager (Data Foundations) Location: London (2-3 days per week in our Holborn office) Employment Type: Full-time, as an employee Prosapient is a global Expert Network firm. We provide clients with rapid access to high-quality, relevant expert insights through a combination of world-class … the UK's fastest growing and most successful female co-founded businesses. At proSapient, we’re building the foundations of next-generation expert intelligence. As we grow our data capabilities, we’re looking for a data-savvy product leader to shape how proprietary and third-party data powers our platform. From driving integrations to … building scalable pipelines, you’ll play a central role in turning raw data into meaningful, actionable insights that enable faster, smarter decisions for our users. The key focus of the role includes: · Owning our data foundations product domain end-to-end: setting vision, defining strategy, and delivering tangible impact to deepen the breadth and quality of More ❯

Social network you want to login/join with: Python Developer (Data Pipelines) | Top Systematic Hedge Fund, slough col-narrow-left Client: Selby Jennings Location: slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Our client, a top systematic hedge fund … are seeking an experienced Python developer to join their Data Team (Alpha Data), which is responsible for delivering vast quantities of data to users worldwide. Heavily responsible for data pipelines. This role involves becoming a technical subject matter expert and developing strong relationships with quant researchers, traders, and colleagues across the Technology … organisation. The Data teams deploy valuable data quickly, ensuring ingestion pipelines and data transformation jobs are resilient and maintainable, with data models designed in collaboration with researchers for efficient query construction and alpha generation. The team builds frameworks, libraries, and services to enhance quality of life, throughput, and code quality. They value More ❯

Social network you want to login/join with: Description of Role and Client: The Head of Data Engineering will lead the technical development and operational management of data engineering solutions for a prominent insurance organization. The client requires a data engineering expert capable of managing complex environments and collaborating with senior technical teams. … This role falls inside IR35. Responsibilities: Design, develop, and manage data pipelines, warehouses, and data lakes. Optimize and maintain enterprise data engineering platforms. Lead strategic management of data engineering solutions across cloud and hybrid environments. Collaborate closely with Data Architects, CIO teams, and senior stakeholders. Continuously enhance the efficiency, reliability … and scalability of data engineering landscapes. Candidate Requirements/Profile: Extensive data engineering experience within insurance sectors. Proficiency with AWS, Azure, GCP, and hybrid data environments. Relevant certifications in cloud platforms or big data technologies. Demonstrated ability to strategically own and enhance enterprise data platforms. Contract duration: Initial 6-month More ❯

Freelance Data Operations Engineer - Market Data (Hedge Fund) Overview We are hiring a Data Operations Engineer to join one of the world's most successful hedge funds, supporting the Market Data and Reference Data team during a critical coverage period. This is a hands-on role focused on real-time … data quality, vendor integration, and operational ownership - ideal for professionals with strong market data and commodities experience in fast-paced financial environments. Key Responsibilities Manage and validate reference data across securities, pricing, accounts, and client data. Ensure data accuracy and integrity from vendor feeds (e.g., Bloomberg, Reuters, IHS Markit, ICE). Handle … Security Master data updates, monitoring, and exception resolution. Collaborate with internal stakeholders to support real-time data needs across trading desks. Develop lightweight Python scripts for automation, validation, and monitoring tasks. Support client-driven enhancements and maintain vendor relationships. Monitor and troubleshoot real-time and static data pipelines. Assist in the integration of data More ❯

Security Cleared Data Engineer - Inside IR35 - Fabric/Azure/Python/C#, Slough Client: Methods Location: Slough, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 2 Posted: 31.05.2025 Expiry Date: 15.07.2025 Job Description: Methods is looking for Data Engineers for a new contract assignment on a hybrid working policy. The client … will be based in London and will require on-site presence 1-2 days per week. The Data Engineer must hold a live Security Clearance used on a Security Cleared site within the last 12 months or be actively using the clearance in their current role. You Will: Design, build, and maintain data pipelines. Ensure data accuracy, consistency, and reliability by implementing validation methods. Implement and enforce data governance policies and ensure compliance with regulations. Build infrastructure for optimal extraction, transformation, and loading (ETL) of data from various sources. Collaborate with stakeholders including data, design, product, and executive teams, assisting with data-related technical issues. This More ❯

customer segmentation, proidling and personalisation projects Help shape the data roadmap from early foundations to advanced maturity. What you'll bring: Strong SQL and data pipeline understanding (you will work with data engineering teams rather than being hands on coding pipelines). Proven experience building dashboards and defining KPIs. Comfortable with data More ❯

a Principal Python Engineer to act as a quantitative overlay on global equity trading operations. The engineering team's goal is to continually improve the entire ecosystem-spanning data, research, trading, and post-trade analytics. As a Principal Engineer, you will own end-to-end delivery of new features and projects, engaging in everything from trading framework design … closely with quants, traders, and other engineering teams to build a robust and scalable CRB platform. Responsibilities: Platform Development: Enhance and maintain the CRB ecosystem, including research tools, data pipelines, trading frameworks, back-testing infrastructure, and post-trade analysis systems. End-to-End Project Ownership: Collaborate with stakeholders to define requirements, design solutions, implement code, and oversee production … and other essential tooling. Performance Optimization: Identify and fix performance bottlenecks in multi-threaded systems, ensuring high availability and low latency. Technical Exploration: Investigate emerging technologies-particularly in data analysis and machine learning-and adapt them to evolving platform needs. Ideal Candidate Background: Experience: 7+ years of professional software development with exposure to capital markets or trading (equities More ❯

from AI agents to APIs to workflows to integrations Set up and manage the cloud infrastructure using AWS, Docker containerisation, and Infrastructure-as-Code with Terraform Build robust data integration infrastructure to connect the platform with various customer systems (TMS, RMS, etc.) and external APIs Implement the workflow orchestration layer to ensure reliable execution of complex agentic behaviours … workflows Skills and Qualifications Experience building end-to-end platform solutions that integrate workflow orchestration systems (like Airflow, Temporal, AWS Step Functions) with real-world business processes and data pipelines Strong background in integration engineering and data modelling Exceptional Python skills for building APIs, services, and data processing pipelines Experience with cloud infrastructure (AWS More ❯

Social network you want to login/join with: You will ensure our customer works with updated and correct data in our data analytics tools by being the first to respond to data health failures on key pipelines, reading code and making changes. About us Hexegic is a leading technical consultancy providing agile multi … projects for those keen to develop and build a successful career. Core Responsibilities Maintain build schedules to ensure pipelines run effectively Set up and maintain health checks on data pipelines Respond to, triage, and debug broken pipelines Read and modify code, and update monitoring … setups Communicate outages to end users What we are looking for Proficiency in reading and writing code in Python, PySpark, and Java Basic understanding of Spark Ability to navigate pipeline development tools What’s in it for you? Base salary of £50,000-£60,000 £5000 annual professional development budget Wellness program 25 days of annual leave Hybrid working More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with … to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka … as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with … to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka … as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team More ❯

Laboratory Systems Specialist is to lead the development and implementation of robust Lab/digital infrastructure within our R&D laboratories. This is pivotal in enabling efficient, automated data exchange between laboratory instruments and enterprise informatics systems such as Electronic Lab notebooks (ELN)s, Laboratory Information Management Systems (LIMS) and other relevant data setups. The ideal … implement, and maintain secure, scalable IT/OT interfaces between lab instruments (e.g., bioreactors, plate readers, liquid handlers) and informatics systems (ELN, LIMS, SDMS, etc.) Collaborate with IT, Data science and scientific teams in R&D to identify integration needs and define architecture for real-time or scheduled automated data transfer. Develop or configure middleware, APIs … and custom connectors—either in- house or in collaboration with external vendors—to enable automated data capture, contextualization, and storage. Manage instrument network connectivity (e.g., OPC-UA, MQTT, REST APIs, TCP/IP) and data pipelines from edge devices to cloud/on-premise environments. Support system validation efforts (e.g., CSV, 21 CFR Part 11 compliance More ❯

is bringing AI design into the real world by enabling generative engineering design for physical products. Our focus is creating millions more engineers globally and giving them the data and knowledge necessary to make efficient decisions quickly, one of the main challenges of the physical engineering industry today. Our team has a background in scaling software to millions … Task orchestration frameworks (e.g. Luigi, Dask, Airflow + Celery etc) Experience owning or being involved longer-term in an open-source project Demonstrable Rust experience or keen interest Data pipelines and big data tech Docker: both building but running too Wide AWS and infrastructure knowledge, including production support Scientific computing e.g. Numpy/scipy/pandas More ❯

with internal stakeholders and external vendors Manage deployments and configuration changes using version control and infrastructure-as-code principles Develop reusable patterns for managing user access, automation, and data pipelines across SaaS applications Own documentation for integration, data handling, and process automation across the application landscape Ensure secure management of sensitive data within cloud More ❯

to have broad knowledge of D365 modules including finance, trade and logistics, stock, warehousing, procurement and sourcing etc. An understanding of the wider Microsoft stack including Azure functionality, Data pipelines and integrations is also desirable. Travel to customer sites to support optimizations or consultancy requirements will be required on occasion. Key Responsibilities: Liaise with clients in order to … implementation with documentation in the role of Senior Consultant Worked in a solution delivery capacity in the past Understanding of the wider Microsoft Stack, e.g. Azure functionality, CE, Data pipelines Willing to expand and train in other areas to cover demand as required Benefits Salary: We offer a competitive, market-aligned salary, that reflects the skills and experience … Kingdom 3 months ago Uxbridge, England, United Kingdom 1 week ago Modern Workplace Engineer/Business Analyst Uxbridge, England, United Kingdom 1 week ago Senior Technical Consultant – CLD – Data Platform Reading, England, United Kingdom 1 day ago Reading, England, United Kingdom 1 day ago Staines-Upon-Thames, England, United Kingdom 9 hours ago Reading, England, United Kingdom More ❯

looking for a Legal AI Engineer who’s passionate about building intelligent systems at the intersection of law and machine learning. You’ll work closely with legal experts, data scientists, and product managers to develop AI features that tackle real legal challenges through the use of agentic GenAI. As Legal AI Engineer you will: Design and implement AI … data. Collaborate with legal SMEs to translate domain knowledge into scalable machine learning solutions. Continuously evaluate model performance, ensuring accuracy, fairness, and compliance. Help shape the data pipeline and MLOps practices for handling sensitive legal content securely. Required Experience: Solid experience with Python and ML/NLP libraries (e.g., spaCy, Hugging Face, TensorFlow/PyTorch). Experience More ❯

Salary: £90,000- 120,000 + Bonus + Equity Options Contract Type: Permanent | Working Pattern: 2–3 Days in Office/Client Site (London) Are you a seasoned data professional with a passion for Snowflake and a knack for leading high-impact technical deliveries? Do you thrive at the intersection of innovation, leadership, and client engagement? If so … Technical Delivery Lead to join our elite team of Delivery Leads. This is more than just a leadership role — it’s a chance to shape the future of data consultancy, drive innovation on the Snowflake platform, and make a tangible impact across a diverse portfolio of clients. ? What You’ll Do Lead with Vision: Drive the development of … technical oversight across multiple engagements, ensuring excellence in execution and client satisfaction. Collaborate & Influence: Partner with clients, internal teams, and Snowflake to scope, design, and deliver cutting-edge data solutions. Mentor & Grow: Coach junior team members and help shape the next generation of data leaders. Innovate & Inspire: Contribute to thought leadership and represent our Consultancy Customer More ❯

Social network you want to login/join with: Staff Data Engineer Salary: £85K - £95K Location: London - Flexible working Data Idols are working with a fast-growing, product-led tech company to hire a Staff Data Engineer and help shape the data platform. They are looking for this person to provide technical … to have real technical ownership over the systems and models that power decision making across the entire organisation. In this role, you'll drive the design of robust data pipelines, evolve our warehouse strategy, and align cross-functional teams around shared, reusable models. You'll be part of a company that takes data seriously, where your … Strong Python SQL Experience working with GCP dbt If you are looking for a new challenge, then please submit your CV for initial screening and more details. Staff Data Engineer #J-18808-Ljbffr More ❯

NLP and modeling experience. You'll work with massive financial datasets to build predictive models that directly impact trading strategies. What You'll Do: Design ML workflows from data ingestion to live deployment Build and optimize data pipelines and benchmarking frameworks Apply NLP and statistical methods to market data What They're Looking For … Strong background in machine learning, NLP, and statistics Proficient in Python and data wrangling Experience with PyTorch, TensorFlow, or XGBoost (a plus) #J-18808-Ljbffr More ❯

SC Cleared Location: Reading, UK Duration:- Full Time Key Skills Required: Agile Expertise: Proven experience as a Scrum Master, Delivery Lead, or Agile Project Manager in tech/data delivery teams Data Awareness: Solid understanding of data pipelines, APIs and data governance Technical Fluency: Comfortable working closely with engineers and architects on … and deliver results Public Sector Experience: Ideally with secure government projects and familiarity with compliance/assurance processes IAM Knowledge: Exposure to Identity and Access Management within secure data environments If interested, please share your CV at chaya@mastek.com Regards Chaya Bahl More ❯