101 to 125 of 201 Permanent Data Pipeline Jobs

Are you an experienced Data Engineer ? Do you have strong AWS skills ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a hybrid working role and you will be based from either their London, Leeds, Manchester or … Edinburgh office, typically 3 days a week from home and 2 day in office/on client site. Responsibilities: Developing and optimizing data pipelines Building and maintaining data architectures Leading projects and teams Ensuring data quality and integrity Preferred skills: Proficiency in AWS Glue … AWS Redshift, and Python Experience with ETL processes, data integration, and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data visualisation tools (PowerBI more »

Principal Data Engineer Location: London (2 days a week in the office) Salary: £90k - £105k (DOE) About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Lead Data Engineer to join their dynamic team. The company prides itself on fostering … edge technology to drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and … integration across various systems. Utilize Python for data manipulation, transformation, and automation tasks. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. Implement data pipelines and workflows to support real-time and batch data more »

our team with people just like you We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Amazon Redshift, Amazon EMR, Amazon Athena, Amazon Sagemaker and more. Help our customers to remove the constraints that prevent them from leveraging their data to develop business insights Create white papers, writing blogs, build demos and other reusable collateral that can be used by our customers. Work closely … with our Solution Architects, Data Scientists and Service Engineering teams Experience with design, development and operations that leverages deep knowledge in the use of services like Amazon Kinesis, Apache Kafka, Apache Spark, Amazon Sagemaker, Amazon EMR, NoSQL technologies and other 3rd parties Develop and define key business questions … needs of enterprises Basic understanding of machine learning fundamentals Ability to take Machine Learning models and implement them as part of data pipeline IT platform implementation experience Experience with one or more relevant tools ( Flink, Spark, Sqoop, Flume, Kafka, Amazon Kinesis) Experience developing software code in one more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal … role in constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions … contact us at 0161 438 1178 for more information. Key skills; AWS Data Engineer, AWS Cloud, Python, SQL, AWS, Glue, ETL Pipelines, Data Engineer, Birmingham, West Midlands Follow us on Twitter @erinassociates for updates on similar opportunities. Erin Associates Ltd is an equal opportunity employer. more »

digital avatars and human clones. Role: MLOps Engineer Location: London Salary: Up to £100,000 Responsibilities: Develop ML Pipelines: Build and maintain scalable data processing systems. Ensure data quality and integrity. Automate ML Processes: Integrate machine learning solutions into existing systems and automate workflows. Deploy and … implementation practices. Ensure Security: Adhere to security and compliance standards in ML deployments. Requirements: Education: Bachelor s or Master s in Computer Science, Data Science, or related field. Experience: 2-3 years in ML, data engineering, or MLOps. Abilities: Strong analytical, problem-solving … and communication skills. Skills: Proficient in Python, ML frameworks like TensorFlow or PyTorch. Experienced with CI/CD, Docker, Kubernetes, and data pipeline tools like Airflow. more »

A fantastic opportunity has arisen for a Data/Software Engineering leader to work within the Personalised Experiences and Communications Platform to join product engineering multi-functional teams . As a Head of data your responsibilities will be delivering the highest quality data capability … the software development lifecycle. Deliver technical solutions that can be utilised across multiple entities across the group. Define consumption and integration patterns and data models and contracts. Create automation tools for data reconciliation and curation. Drive the culture of delivering highly secured and high-quality software. … to make our Group a wonderful place for everyone. Including you. We understand no one can be an expert in every aspect of data/software Engineering . However, if you have coding or scripting knowledge/experience with a data engineering background , we would like more »

A fantastic opportunity has arisen for a Data/Software Engineering leader to work within the Personalised Experiences and Communications Platform to join product engineering multi-functional teams . As a Head of data your responsibilities will be delivering the highest quality data capability … software development life cycle. Deliver technical solutions that can be utilised across multiple entities across the group. Define consumption and integration patterns and data models and contracts. Create automation tools for data reconciliation and curation. Drive the culture of delivering highly secured and high-quality software. … to make our Group a wonderful place for everyone. Including you. We understand no one can be an expert in every aspect of data/software Engineering . However, if you have coding or Scripting knowledge/experience with a data engineering background , we would like more »

LEAD DATA ENGINEER LONDON BASED £80,000-90,000 PER ANNUM This Real estate company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and … SQL. You will also be responsible for building a new Data platform in GCP. THE COMPANY This growing company are searching for a new Lead Data Engineer, to own the technical direction of their expanding Data and Technology team. They have been investing heavily … in their data team over recent years, and are a very data-focused business. THE ROLE Joining this team as a Lead data engineer, you will be responsible for building the company's next-generation data platform using GCP. This role has more »

At AX, we are looking for a Data Engineering Lead to join our dynamic team. As the Data Engineering Lead you will have a strong background in data analysis, team management, and expertise in utilizing various Microsoft BI tools and cloud-based technologies including … SSRS, SSIS, SSAS, Azure Synapse, Azure Data Factory and lakes and curated business models. A little bit about us AX is an accident assistance and after care service provider who deliver replacement vehicles to customers who have been involved in non-fault accidents. We pride ourselves on keeping … and engaging with our colleagues is fundamental to ensure we provide an industry leading service to our partners and our customers. As our Data Engineering Lead, your responsibilities will include: Team Leadership Provide leadership, guidance and support to team members, ensuring the successful execution of projects and tasks. more »

you will play a pivotal role in bridging technology and strategy. You will collaborate with premier consulting teams around the world, applying your data engineering expertise across a variety of ambitious and ground-breaking international projects. You will be instrumental in advancing BCG's Consulting and BCG X … teams by providing critical data engineering development insights and speeding up project execution. What You'll Bring Technical Skills - Knowledge and Experience with: Unix-based command line & development tools Version control (e.g. Git) Python Charting libraries (e.g. HighCharts, D3.js, Recharts, Plotly, Altair) Cloud computing platforms (e.g. AWS, Azure … Redis, etc) Spark or other distributed big data systems (e.g. Hadoop, Pig, Hive, etc.) Stream-processing frameworks (e.g. Kafka) Data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster, etc.) Job Requirements: Bachelor's/Master's in Computer Science, a related field, or equivalent work experience more »

Senior Vice President of AI & Data - London ( Hybrid ) £130,000 - 150,000 What you'll do Our Artificial Intelligence & Data experts work within integrated teams from enterprise improvement, financial advisory and turnaround and restructuring; meaning the jobs we do cover every aspect of a business. Along … their skills and experience to create measurably improved outcomes for our clients. In this challenging role, you will be responsible for using your data analytics and technology skills to improve your client's performance. As part of our team, you will lead organisations through their most complex business … problems using data, analytics and technology. You will work across a number of industries, clients, and project roles. As an integral part of the project team you will use data to assess client performance and help define their business objectives and strategy. You will conduct the more »

the BCG X Delivery team and immerse yourself in cutting-edge projects alongside our consulting units. Your role will be pivotal in employing data engineering methodologies to enhance the capabilities of both BCG Consulting and BCG X teams, across various domains. You'll be the go-to expert … for data engineering, offering accelerated execution support to bring visions to life. Your collaboration will be key in understanding project requirements, leading the design, development, delivery, and support of solutions tailored to client needs. Expect to dive deep into tools and processes, ensuring the delivery of high-quality … Redis, etc) Spark or other distributed big data systems (e.g. Hadoop, Pig, Hive, etc.) Stream-processing frameworks (e.g. Kafka) Data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster, etc.) Job Requirements: Bachelor's/Master's in Computer Science, a related field, or equivalent work experience more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

Job Description As people increasingly move across channels and platforms, Kantar Media s data and audience measurement, targeting, analytics and advertising intelligence services unlock insights to inform powerful decision-making. Working with panel and first-party data in over 80 countries, we have the world s … East, Asia Pacific, North America, and Africa to understand audiences and help the world s leading organisations succeed and grow. Job Title: Senior Data Scientist Location: London, Grays Inn Road Salary: Competitive Full time/Permanent Kantar is the leader in providing audience and advertising measurement tools and … the forefront of technological developments in audience measurement in the media industry, working with broadcasters and advertisers, media agencies and industry committees. The data science team provides research and technical expertise, support, oversight, and methodological development to our global operating services and sits within the Global Product team. more »

Engineering Lead (Data) - Personalised Communications & Experiences Platform SALARY: £86,964 - £102,310 LOCATION: Bristol (Hybrid, at least two days per week in the Bristol Office) Opportunity Lead multi-functional engineering teams within the Personalised Experiences and Communications Platform, delivering high-quality data capabilities and leveraging cloud … squads for skill development and career growth. Technical Solutions: Troubleshoot, debug, and resolve issues; deliver reusable technical solutions. Patterns & Models: Define integration patterns, data models, and contracts. Automation: Create tools for data reconciliation and curation; drive process automation. Best Practices: Implement TDD, code reviews, and CI … operational stability. Expertise in automation and CI/CD. Proficiency in Python, Java, Rust, JavaScript, React, Angular, TensorFlow, PyTorch. Experience with large-scale data sets, data pipelines, and cloud platforms (AWS, Azure, Google Cloud). Experience in distributed systems and event-driven architecture. Practical experience with more »

the BCG X Delivery team and immerse yourself in cutting-edge projects alongside our consulting units. Your role will be pivotal in employing data engineering methodologies to enhance the capabilities of both BCG Consulting and BCG X teams, across various domains. You'll be the go-to expert … for data engineering, offering accelerated execution support to bring visions to life. Your collaboration will be key in understanding project requirements, leading the design, development, delivery, and support of solutions tailored to client needs. Expect to dive deep into tools and processes, ensuring the delivery of high-quality … Redis, etc) Spark or other distributed big data systems (e.g. Hadoop, Pig, Hive, etc.) Stream-processing frameworks (e.g. Kafka) Data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster, etc.) Job Requirements: Bachelor's/Master's in Computer Science, a related field, or equivalent work experience more »

Business Development Manager - Data Solutions Stride Recruitment is working with a leading data consultancy focused on delivering Data & Analytics Solutions for clients in markets such as; Financial Services, Retail, CPG, and Telco. They specialise in the delivery of Modern Data Solutions for … firms in their chosen target markets. Using innovative technologies, they deliver data pipelines, cloud data architectures, advanced analytical and AI/ML solutions. We are looking for ambitious and self-motivated sales professional with a passion for helping customers achieve more with Data, Analytics … Demonstrated ability in negotiating high-value contracts with a track record of successful deal closures. Analytical Mindset: Strong analytical skills to understand complex data environments and articulate the value proposition of our solutions effectively. Technological Proficiency: Familiarity with the latest trends in data analytics, machine learning more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

About the roleA Payments FinTech are currently seeking a Data Engineering Lead (Python, Hadoop & SQL) to lead and mentor a talented team of data engineers and scientists as they look to simplify the bank through developing innovative data driven solutions, allowing them to be … business-critical platforms.Desirable skills & experienceWorking to an Agile methodology and familiarity with Azure DevOpsDeep automation knowledge with PythonSkilled in Pyspark and SynapseExperience with data modelling and visualisation in Power BI (or alternative)A strong understanding of architecting data platforms, BI, MI, or analytics solutionsStrong experience using … Azure Data Lake, Azure Data FactoryDeliver the automation data pipelines and building of a scalable data architecture. more »

Our client who is a house hold UK name branded business are urgently looking for a Data Engineering Manager to lead a small team of data engineers. Responsibilities: Manage a team of data engineers. (must have managed before, not looking for senior data engineers looking to make the next step. Oversee the design, development, and maintenance of data pipelines. Collaborate with cross-functional teams to ensure data quality and availability. Lead projects related to data integration, transformation, and storage. Implement best practices for data engineering processes. Requirements: Previous experience managing a team of data engineers. Proficiency in Azure (including services like Azure Data Factory, Azure Databricks, etc.). Strong programming skills in Python . Familiarity with data modeling, ETL processes, and data warehousing. Excellent more »

In this role, you'll be part of a team that leverages cutting-edge tools and technologies to extract, analyse, and visualise complex data, ultimately contributing to the organisation's success. If you're driven, adaptable, and thrive in a fast-paced environment, we encourage you to apply. … Responsibilities: Conduct data manipulation and transformation in Azure, Snowflake, and other specified data warehouses Design and execute data solutions. Manage dataset access and controls. Draft and validate processes. Document and log structural alterations in Azure/Snowflake. Develop and sustain data processes … applications, and features. Deploy and uphold database objects. Enhance and maintain tools for system analysis. Construct and manage Power BI data models in line with team requirements. Collaborate with stakeholders to implement existing and newly acquired contracts. Establish and maintain data warehouse infrastructure, flows, and pipelines. more »

Data Engineer - London - £65,000 I am currently working with a London based organisation who operate in the events management space who are looking for a Data Engineer to join their team. The team have recently re-developed the cloud based data platform with … the goal of fully utilising data across multiple business departments. In this role you will work as part of a close-knit team of 7 data focused professionals. This will comprise of Data Architects, Engineers and Analysts and you will work collaboratively to deliver … on the company's data goals. You will be responsible for the creation and development of ETL pipelines, the ongoing maintenance of the data platform and being the internal SME for all things data! You will join a business who hold its people at more »

Python Data Engineer Location: 2 days WFH/3 days in London Salary: Circa 50K 60K + Bonus + Benefits Python Data Engineer required by fast-growing asset management firm where youll be able to use your Python expertise to drive data-driven decisions … This is a varied, challenging role focusing on building reliable data pipelines and working with large datasets Essential: At least 2yrs Python programming experience and cloud architecture Experience working with large datasets and data pipelines Knowledge of data modelling, data warehousing, and … ETL processes Familiar with Linux, Git & SQL Nice-to-have: GCP Machine learning and/or data science Tremendous opportunity offering plenty of scope for career progression in a friendly, collaborative environment where youll be able to bring ideas and keep up-to-date with the latest technologies more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »