151 to 175 of 446 Data Pipeline Jobs

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead … the development of robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure … to help enhance support for new lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data lineage. The successful candidate will have: A strong background in data engineering using Python Strong understanding of Test Driven Development Experience building Star Schemer Databases more »

Senior Data Engineer- Fast growing SaaS Scale up 🚀 West Midlands- hybrid working Up to £86K base with bonus and benefits The client SaaS Software business platform which is revolutionising financial management for their customers. Responsibility: Working to ensure a high-quality data platform. Design, develop, test … and deploy data pipelines and integrations using IPaaS technology Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem Willingness and an enthusiastic attitude to work within existing processes/methodologies. Collaborate with … the DevOps team to provide high availability data solutions that scale geographically. Big data processing - Expertise in processing enterprise-scale volumes of data, ideally with proficiency in Snowflake. Experience Data Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise more »

Data Engineer Location: London – Hybrid Employment: Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity: For the Ministry of Defence (MOD), maintaining National Security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with this … Big 4 Firm to support its multidisciplinary AI & Cloud Data Engineering Capabilities. The Role: As an AI & Cloud Data Engineering practitioner, you’ll build large-scale data pipelines and infrastructure, utilising data integration tools to optimise complex data solutions. Collaborating … with high-performing Data Science and ML Engineering teams to drive innovation and insight through AI and Data across the Defence & Security sector. Required Skills/Experience: British Passport Holder with active DV (Developed Vetting Clearance) End-to-end development with data pipelines, ETL more »

Programmer Analyst IV, Information Resources- Department of Information Resources - Enterprise Data Services Why UT Southwestern? With over 75 years of excellence in Dallas-Fort Worth, Texas, UT Southwestern is committed to excellence, innovation, teamwork, and compassion. As a world-renowned medical and research center, we are looking for … team where you'll discover a culture of teamwork, professionalism, and a life-changing career! Job Summary The Department of Information Resources, Enterprise Data Services is seeking an Programmer Analyst IV to join their team. This important role requires the following knowledge and skills: Cloud Platforms: Strong proficiency … etc. Data Engineering Tools and Technologies: Proficiency in SQL for data querying, manipulation, and analysis. Experience with data pipeline orchestration tools like Apache Airflow, Azure Data Factory, AWS Glue, etc. Knowledge of programming languages such as Python, Java, or Scala for more »

About Us Airtime Rewards is delivering the leading data-led rewards technology globally. We believe every shopper should feel great about their daily spend. Our app is loved by our members (>3.5m!) and we're continually building new features that drive towards our vision that sees hundreds of … and insight that transforms their understanding of their customers. We do all this with our cutting-edge proprietary technology, utilising real-time purchase data and AI learning to delight our members and maintain relationships with >200 retailers (including Boots, Aldi, Tesco, Greggs, Selfridges, and Halfords to name a … ourselves on culture, are solving new problems, and need great people to join us on our international journey as we deliver the leading data-led rewards technology globally. The Opportunity We are looking to recruit a Data Engineer to join and strengthen our existing team and more »

proficiency in most areas of the professional function and in-depth specialization in some. Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Anticipates and prevents problems and roadblocks before they occur. Networks with senior internal and external personnel in own area … process, testing & operations Experience integrating third party SDK's like Facebook, Adobe etc Experience with integrating with Back-end Services (APIIs, GraphQL, etc.) Data & Analytics 4+ years experience in integrating, transforming and consolidating data from various structured and unstructured data systems for building analytics … technologies like Data Flow, Data Bricks, Azure Synapse, Azure Analysis Services and Power BI Analytics Experience in Data Pipeline and integration workflow management tools: Talend, Store Proc, Change Data Capture (CDC), Spark & Azure API's . click apply for full job more »

proficiency in most areas of the professional function and in-depth specialization in some. Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Anticipates and prevents problems and roadblocks before they occur. Networks with senior internal and external personnel in own area … process, testing & operations Experience integrating third party SDK's like Facebook, Adobe etc Experience with integrating with Back-end Services (APIIs, GraphQL, etc.) Data & Analytics 4+ years experience in integrating, transforming and consolidating data from various structured and unstructured data systems for building analytics … technologies like Data Flow, Data Bricks, Azure Synapse, Azure Analysis Services and Power BI Analytics Experience in Data Pipeline and integration workflow management tools: Talend, Store Proc, Change Data Capture (CDC), Spark & Azure API's . click apply for full job more »

Are you passionate about leveraging data to drive business success? Do you thrive in dynamic environments where innovation is valued? Look no further - our client, a global leader in the prosthetics industry, is seeking a talented Data Engineer to join the Data Insights & Advanced … Analytics team within Global IT. This client believes in the power of data to transform our business and enhance the lives of patients worldwide. As the central Data & Analytics partner of the global business, they are committed to providing cutting-edge infrastructure, data engineering … tools like Azure Data Factory and Databricks. Integrate new data sources into our Azure Data Lake and monitor pipeline performance. Bring your own ideas and contribute confidently to the dynamic team environment. What we would like from you: Master's degree in Computer more »

DATA ENGINEER LONDON HYBRID - 3 DAYS IN THE OFFICE UP TO £60K This role does not have the ability to sponsor THE COMPANY A leading provider in accommodation focused on taking advantage of their raw data sources to provide a nurturing environment facilitating personal growth and … vibrant communities THE ROLE AND RESPONSIBILITIES You will be responsible for bringing together all data sources into an Azure Cloud Data Warehouse to be leveraged for BI reporting and analytics In this role you will: Designing, implementing, and maintaining data pipelines across multiple data pipelines across multiple cloud SQL environments to ensure data integrity, security, and performance are maintained to a high standard Work with the BI team to design and build best-in-class data warehouse components Designing, building, and maintaining quality ETLs and ELTs to make more »

Data Engineer with Azure & Power BI Permanent £65-70k + Great Bens Hybrid Flexible Working - London area Talented and experienced Data Engineer/Power BI Developer, strong in both interpersonal communication skills, as well as key technical experience including; strong SQL, Azure Synapse Analytics and … Power BI (DAX & PowerQuery). This is a key technical role to join a small dynamic and friendly team, responsible for the data that enables our client to deliver premium entertainment to a Global network of over a billion airline passengers. You will … play a crucial part in the continued development and maintenance of the existing data warehouse solution, including data analysis, integration pipeline creation, SQL JSON querying and reporting using Power BI. The cloud based systems leverage data to support operational activities and inform business more »

Data Scientist - Hybrid/Bristol Job Title : Mid-Level Data Scientist Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and … dependability. Integrate advanced machine learning elements into data pipelines to elevate data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross … functional team members in an agile development setting to meet project objectives and deadlines. Harness modern NLP techniques to enrich data comprehension and processing. Stay abreast of the latest advancements in data science and engineering to continuously refine our systems and methodologies. About Us : Situated in more »

Job Role: Azure Data Engineer Location: Central London - Hybrid/3 Days in Office Salary: £60,000 - £70,000 + 12.5% Bonus Chapman Tate is collaborating with a leading property management company that is revolutionizing the industry through innovative data-driven solutions. As they continue to … expand their operations, they are seeking a talented Azure Data Engineer with strong SQL expertise to join their dynamic team. Are you passionate about leveraging data to drive business insights and enhance operational efficiency? Do you have experience working with Azure data technologies and … so, this is an exciting opportunity to contribute to the success of a forward-thinking property management company. Responsibilities: Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory. Optimize data storage and retrieval processes to ensure scalability, reliability, and performance. more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »

Job Title: Data Operations Analyst Company: Global Asset Manager Location: City of London, 3 days per week in office Salary: £85,000 per annum + Benefits About the Company: Join a prestigious global asset manager with over $200 billion in assets under management. Our firm is renowned for … excellence. Based in the heart of London's financial district, you'll be part of a dynamic team shaping the future of financial data operations. Role Overview: As a Data Operations Analyst, you will play a pivotal role in implementing a cutting-edge global platform aimed … at centralizing data management processes. Leveraging your expertise in R, Python, SQL, and Enterprise Data Management (EDM), you'll contribute to streamlining data workflows and optimizing data quality across the organization. Key Responsibilities: Collaborate with cross-functional teams to understand data more »

Contract Data Analyst Length: 6 Months (Possible Extention) Rate: Up to £400 per day (Outside IR35) Location: Central London (Hybrid 2/3 Days) I am seeking a skilled Data Analyst to join my clients Digital & Tech team for a contract role. You will aid in … supporting a system implementation and data migration project, collaborating closely with project members, including the Senior Data Analyst, to navigate data challenges and suggest optimal approaches. Ideal candidates have expertise in data collation, profiling, scripting, and report writing, with agility in deploying … Dynamic Tables, and Tasks (in SQL and/or JavaScript) Understand the purpose, functionality and deployment of unit tests in a data pipeline Python skills; be able to write scripts for data processing, cleaning, transformation and analysis Knowledge of various python packages; pandas, SQLite Power more »

We are currently seeking a Snr Data Engineer who has experience with the Azure Data stack to join the Business Intelligence team. The team is part of a wider team that includes the MS D365 implementation team (on-going project), Oracle ERP team and Digital Applications … to deliver MI reporting to our Finance stakeholders. Main responsibilities Collaborate with business stakeholders, process owners and BAs to understand requirements. To build data pipelines, reading data from various on-premise or cloud services to the Azure datalake. To design and build data models … suitable for reporting. To design and build Reports. Implementation of Data Quality, Data Governance, Data Security processes as part of the solution design About the Candidate Essential experience Experience with the following technologies Azure Synapse, Data Factory, Databricks, SQL Db, Datalake, Key more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … to build a brand-new Snowflake data warehouse, which brings a huge scope of work for you to lead on internally, including the development of scalable data pipelines, overseeing the integration of new data management technologies, and implementing data storage solutions. This more »

Job Title: Data Operations Analyst Company: Global Asset Manager Location: City of London, 3 days per week in office Salary: £85,000 per annum + Benefits About the Company: Join a prestigious global asset manager with over $200 billion in assets under management. Our firm is renowned for … excellence. Based in the heart of London's financial district, you'll be part of a dynamic team shaping the future of financial data operations. Role Overview: As a Data Operations Analyst, you will play a pivotal role in implementing a cutting-edge global platform aimed … at centralizing data management processes. Leveraging your expertise in R, Python, SQL, and Enterprise Data Management (EDM), you'll contribute to streamlining data workflows and optimizing data quality across the organization. Key Responsibilities: Collaborate with cross-functional teams to understand data more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … to build a brand-new Snowflake data warehouse, which brings a huge scope of work for you to lead on internally, including the development of scalable data pipelines, overseeing the integration of new data management technologies, and implementing data storage solutions. This more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … to build a brand-new Snowflake data warehouse, which brings a huge scope of work for you to lead on internally, including the development of scalable data pipelines, overseeing the integration of new data management technologies, and implementing data storage solutions. This more »

change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS. Job Description As a Principal/Senior Data Engineer, you will spearhead our data initiatives, transforming raw data into strategic assets that propel our business forward. This role … who excel in a dynamic environment, offering the freedom to innovate and the responsibility to deliver. Core Responsibilities: Identify and harness high-value data opportunities within our product suite, converting raw data into impactful features and reusable assets. Act as the authoritative voice on data … Strong programming skills in Python, Scala, C#, or Java, and adeptness with cloud SDKs and APIs. Deep understanding of AI/ML to enhance pipeline efficiency, with experience in TensorFlow, PyTorch, AutoML, Python/R, and MLOps platforms like MLflow and Kubeflow. Solid background in DevOps , including CI/ more »

Our client, a leading MCR innovator, is seeking a skilled Data Engineer with expertise in GCP, SQL and Python. You'll join a team leveraging the latest advancements in Machine Learning and Google Cloud Platform to build game-changing tech that will help direct the future trajectory of … be based in the UK without visa/sponsorship requirements) It should go without saying, but a technical mindset and passion for the data engineering space an absolute must, with the ideal applicant being adept at delivering and optimising data pipelines. Some of the key things … you’ll be doing include: Build reliable data pipelines to move data from internal systems Keep the data pipelines running smoothly and ensure the data is accurate, complete, and accessible. Make the pipelines work faster and cheaper by improving their efficiency. Understand more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … to build a brand-new Snowflake data warehouse, which brings a huge scope of work for you to lead on internally, including the development of scalable data pipelines, overseeing the integration of new data management technologies, and implementing data storage solutions. This more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … to build a brand-new Snowflake data warehouse, which brings a huge scope of work for you to lead on internally, including the development of scalable data pipelines, overseeing the integration of new data management technologies, and implementing data storage solutions. This more »