1 to 25 of 498 Data Pipeline Jobs in England

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … Azure or AWS cloud services, and a proven track record in delivering high quality work to tight deadlines. You will work closely with data scientists, software engineers, and domain experts, to gather the business needs and translate them into AI applications. Designing, testing, evaluating, and deploying cutting-edge … efficiency of various domains. There will also be the opportunity to research and implement best practices and standards for AI development, such as data quality, scalability, security, and ethics. SC Clearance/Eligibility required. Qualifications Experience in developing and deploying AI solutions using Python, TensorFlow, PyTorch, Keras, Snowflake more »

role demands both high technical aptitude and problem-solving abilities, motivation, and exceptional attention to detail. At Roku, we are a company of data-focused builders, particularly on the Search and Recommendations team. Every day, you'll have the opportunity to assess existing systems and find ways to … applying Machine Learning to concrete problems at large-scale. Strong CS fundamentals, with the ability to write algorithms with ease. Good understanding of data science and machine learning fundamentals like regression, classification, tree-based approach, neural networks, and sequence-based models. Experience with advanced machine learning techniques, including … and artwork. Proven familiarity with NLP approaches like Word2Vec or BERT, including identifying the right KPIs and objective functions. Experience working with big data systems (Spark, EMR, Kafka, S3, Airflow) and programming languages (Java, Scala, or Python). Experience building in-production Machine Learning systems Good understanding of more »

Job title: Lead Data Engineer Client: Hyper Scaling AI/FinTech Startup Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. … Being a Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead … based on very specifically tailored data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with market developments in the data engineering and AI space and implement these best practices. Requirements and Skills: Bachelor more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

understand client requirements and provide technical expertise during pre-sales engagements. Design and implement Proof of Concepts (POCs) to showcase the potential of data integration solutions and demonstrate value to clients. Prepare technical proposals and cost estimates for data integration projects. Conduct client presentations and answer … technical questions effectively. Design, develop, and deploy data pipelines for ingesting, transforming, and loading data from various sources into target systems (cloud and on-premises). Implement data cleansing, quality checks, and transformation logic to ensure data integrity and … accuracy. Configure and manage data integration tools, including cloud-based platforms and on-premises solutions. Automate workflows and schedule data pipeline execution for efficient data processing. Monitor data pipelines for performance and troubleshoot any issues. Collaborate with data analysts more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Amazon Redshift, Amazon EMR, Amazon Athena, Amazon Sagemaker and more. Help our customers to remove the constraints that prevent them from leveraging their data to develop business insights Create white papers, writing blogs, build demos and other reusable collateral that can be used by our customers. Work closely … with our Solution Architects, Data Scientists and Service Engineering teams Experience with design, development and operations that leverages deep knowledge in the use of services like Amazon Kinesis, Apache Kafka, Apache Spark, Amazon Sagemaker, Amazon EMR, NoSQL technologies and other 3rd parties Develop and define key business questions … needs of enterprises Basic understanding of machine learning fundamentals Ability to take Machine Learning models and implement them as part of data pipeline IT platform implementation experience Experience with one or more relevant tools ( Flink, Spark, Sqoop, Flume, Kafka, Amazon Kinesis) Experience developing software code in one more »

Data Engineer We're partnering with a with a global financial services institution that are embarking on an ambitious project: to build an industry-leading data platform. The long-term vision is to migrate all data within the coming years and embed any new … products within this platform. What you’ll be doing You'll play a pivotal role in designing, developing, and maintaining the company's data infrastructure. You’ll collaborate with cross-functional teams to ensure efficient data collection, storage, and retrieval, paving the way for superior analysis … insights. Your expertise will be crucial in: Supporting solution design activities and shaping the team's approach. Developing, testing, and documenting scalable ETL data pipelines. Ensuring design aligns with the company's technology strategy and standards. Implementing robust data security measures and ensuring compliance. Becoming a more »

We are looking for an experienced Senior Data Engineer passionate about designing and building high-quality data pipelines to power cutting-edge genAI products. The ideal person would have a strong background and expertise in real-time data streaming and cloud technologies. They would … The person we’re looking for We are looking for a self-starter who can see the big picture and understand how our data points are connected. You should be able to use your excellent communication skills to simplify and explain concepts to others. You will also be … bringing out the best in them, have excellent communication skills and enjoy fostering best practices. You’ll be responsible for Serving as a data engineering subject matter expert Owning and shaping our data streaming roadmap Collecting use cases and requirements from the wider data more »

Principal Data Engineer - Bristol This Digital Services Partner revolutionises how people engage with technology. They pride themselves on delivering innovative solutions that enhance user experiences and drive measurable results. People are genuinely at the heart of this business, and they're looking for a Principal Data Engineer to join. This role will provide technical expertise in data engineering practices both internally and to clients, and provides great opportunity to develop and upskill. The role: Act as a technical SME to help produce user centred software Design and manage software deployment and development … teams to prioritise workload and realign where needed Be a strong communicator, present prototypes and solutions to stakeholders The person: Strong experience in Data Engineering, with python being your primary language Strong cloud exposure - AWS, GCP or Azure Excellent SQL and relational database skills - NoSQL desirable Experienced in more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … policies. Essential Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. … Building Azure data pipelines. Agile methodology experience. Problem-solving skills. Awareness of industry trends. Stakeholder engagement. Desired Experience Business Objects Reporting. Power BI familiarity. more »

Data & Analytics Permanent - Full Time London, GB, W12 7FA BBCS Americas Inc Job Closing Date: 27/05/2024 THE ROLE ABOUT BBC STUDIOS BBC Studios is a world-renowned content studio and channels & streaming business, powered by British creativity, with a reach that touches audiences in … the world; and the UK’s largest distributor of British content. THE ROLE BBC Studios now have an exciting vacancy for a Senior Data Analyst within our award winning International News division. Working within our Consumer Growth and Monetisation team the Audience Growth analyst will have a passion … for data, discovery and visualization across multiple data points and a hunger to learn and work within the fields of SEO, Search and marketing channel analytics. This role will support data driven decision making, leveraging search data from the Google ecosystem, ad more »

Full Stack Developer/Data Engineer opportunity. Full time permanent position. Fully remote or hybrid - office just outside of London. My client is a dynamic and rapidly growing electrification company dedicated to the decarbonisation of heat transport and induction. They have years of experience from across the energy … sector in integrating and connecting renewable generation, EV charging and the digitalisation of energy. They are seeking a Full Stack Developer/Data Engineer with Data bricks expertise to help tackle exciting challenges in the energy sector. In this role, you will: Develop and scale energy … solutions: Bring ideas to life, building robust and scalable applications from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance more »

Exciting Opportunity: Senior Data Analyst Role 🌟 Are you a seasoned data professional looking for your next challenge? We have an exceptional opportunity for a Senior Data Analyst to join a leading global financial institution’s dynamic Risk Analytics team. 🔍 Role Focus: Data provisioning and ensuring seamless access to vital data sources. Managing and optimizing data storage solutions. Automating processes to enhance efficiency and accuracy. Conducting comprehensive data analytics to support risk management and strategic decision-making. 🎯 Key Responsibilities: Develop and maintain data pipelines and infrastructure. Implement and oversee data governance and best practices. Collaborate with cross-functional teams to drive data-driven insights. Utilize advanced analytics techniques to solve complex business problems. Utilize SQL and Python. 💼 What We Offer: A collaborative and innovative work environment. Opportunities more »

AWS Data Engineer | £50-60k | Fintech | Hybrid Leeds Want to work for a business that uses Data to create predictions that shape the future of fintech decision making? If so, AWS Data Engineers this one is for you... About the business 🚀 G.Digital has … how the everyday person gets closer to financial freedom! They've kicked off some exciting new projects including the development of a new Data Lakehouse and the implementation of an iPaaS solution and now they're looking to hire a Data Engineer to join their small … Python Any exposure to Terraform would be great Liaising with other areas across the business to help define requirements for new projects, including both pipeline and ETL requests What’s on offer to you? 💰 £50-60k Bonus of up to 10% Flexible working (core hours) Private health more »

team. This team is responsible for and enhancing the business’s lead management and CRM capabilities BI analysts with accurate and relevant application data business insights and predictive models developed by the BI team into self-optimising, productionised systems within the wider business. The ideal candidate will be … responsible for developing and maintaining data pipelines and queries to extract complex datasets needed for our business intelligence and reporting needs. Additionally, the candidate will be involved in writing production-level code to support the organisation’s various CRM and lead-management applications and systems. Key Responsibilities: 1. … Data Extraction and Transformation: Design and develop data pipelines and queries, for efficient data extraction and transformation. Collaborate with cross-functional teams to understand data requirements and ensure accurate and timely delivery of BI solutions. 2. Business Intelligence: Work closely with business more »

AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision … to provide specialist services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You … will work closely with various teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using more »

AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision … to provide specialist services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You … will work closely with various teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using more »

Role: Senior Data Analyst Salary: £35,000 - £40,000 Location: Peterborough – onsite. Our client, a leading retail fashion brand, are looking to recruit a Senior Data Analyst into the team. With Data at the core, they are looking for someone to really help drive … forward the data strategy for the business. Having recently implemented Snowflake, this role will be well suited to those comfortable with creating data pipelines, using various ETL tools, testing data and writing queries. Please take look at some of the core requirements below and … with this role** Key Responsibilities: · Generate and maintain reports on sales performance and marketing activity across various channels. · Extract, manipulate, and analyse commercial data to provide actionable insights. · Create informative dashboards using Tableau. · Identify and resolve data discrepancies. · Maintain reporting for the marketplaces team. · Mentor junior more »

analytics to the global capital and commodity markets. As a Python Developer you will play a pivotal role in developing and maintaining advanced data processing and analysis solutions. You will collaborate closely with cross-functional teams to design, implement, and optimize Python-based applications, with a particular emphasis … on utilizing Airflow and also pandas for efficient data manipulation and analytics. This role offers an exciting opportunity to contribute to the transformation of their business through the application of innovative technologies. Responsibilities: Develop robust, scalable, and maintainable Python applications tailored to the needs of our insurance operations. … Collaborate with data engineers, data scientists, and business analysts to understand requirements and translate them into technical solutions. Working with Product team to integrate financial products of external clients, manage data flows, source market data and analyse financial algorithms. Utilize Pandas for more »

you want to design and build attractive digital products and services? Are you an analytic thinker? Do you enjoy creating valuable insights with data? Are you confident at iteratively refining user requirements and removing any ambiguity? In your role you will: • transform data into valuable insights … that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques • provide technology solutions that will solve business problems and strengthen our position as digital leaders in financial services • develop and maintain data pipelines and build out API integrations to support … increases in data volume and complexity • apply a broad range of software engineering practices, from analyzing user needs and developing new features to automated testing and deployment Your team In our agile operating model, crews are aligned to larger products and services fulfilling client needs and encompass multiple more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … Azure or AWS cloud services, and a proven track record in delivering high quality work to tight deadlines. You will work closely with data scientists, software engineers, and domain experts, to gather the business needs and translate them into AI applications. Designing, testing, evaluating, and deploying cutting-edge … efficiency of various domains. There will also be the opportunity to research and implement best practices and standards for AI development, such as data quality, scalability, security, and ethics. SC Clearance/Eligibility required. Qualifications Experience in developing and deploying AI solutions using Python, TensorFlow, PyTorch, Keras, Snowflake more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … lifecycle design, data ontology alignment, annotated datasets, and elastic search approaches Developing, creating and maintaining a reliable data pipeline and schemas that feed other data processes; includes both technical processes and business logic to transform data from disparate sources more »

s overall commitment to responsible business practices. Ready to level up your career? Playtech‘s BI Unit is looking for an expert Senior Data Engineer with excellent analytical mind set and problem-solving skills to join our Data Programme team Job Description Your influential mission. You … will... Be designing, implementing, and maintaining scalable and efficient data pipelines, ensuring data quality, and optimizing data processing performance Strength our data stack to bear the load of our ever expanding, data driven business Develop and maintain data models, ETL processes, and data warehousing solutions to support analytics, machine learning, and reporting Ensure data security and compliance with industry regulations and best practices Identify, analyse, and resolve data-related issues to improve data reliability and maintain data more »