51 to 75 of 200 Permanent Data Pipeline Jobs

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

About the role: My client is seeking an experienced Senior Data Engineer with a specialisation in Snowflake and DBT to own and evolve the company's data stack. The ideal candidate for this role will be a self-starter with a knack for problem-solving and … a strong ability to learn new skills quickly. Key responsibilities include designing and developing scalable data models and warehouses, creating and maintaining database objects, and ETL processes for loading data into Snowflake. Proven proficiency in SQL, database optimisation, and effective database security implementation is a must … working closely with Data Science team). The candidate should also have good communication skills, an approachable personality, and prior knowledge/experience of the media industry will be beneficial. The role provides personal and professional development opportunities for an individual who can take on ownership and responsibility more »

partnering with banks, businesses and fintechs all over the world. Partner with Visa: A Network Working for Everyone. What s it all about? Data Engineering Team at VXBS Our small but dynamic data engineering team we play a pivotal role in managing critical aspects of VXBS … s data ecosystem. AWS : Our cloud computing platform. Snowflake : Our trusted data warehouse platform. DBT Core : We leverage DBT for data transformations and modelling. Matillion : An essential tool for orchestrating ETL workflows. Datadog: For monitoring and alerting. Terraform for our infrastructure, including Snowflake. The … Balancing Act: As we embark on a transformation journey toward a more modern data stack, we find ourselves juggling our current workload while keeping an eye on the future. Our mission: seamlessly transition to a stack that empowers us even further. Join us as we navigate this exciting more »

your future, while being the reason millions of people find a brighter financial future with Discover. Job Description: Seeking Manager of Software Engineering (Data Engineering) Responsible for the technical development of software engineering staff within a Discover application development area while using your technical expertise to drive vision … quality technology solutions for a product or set of products including developing own subject matter expertise. Develop and manage a team that delivers data and analytic technologies. Consult team members during project design and development. Develop and enhance technology solutions to support seamless integration and flow of data … data-driven solutions to meet business requirements Ability to quickly identify an opportunity and recommend possible technical solutions. Custom Data pipeline development (Cloud and locally hosted) Work heavily within the Cloud ecosystem and migrate data from Teradata to AWS based platform. Ensure proper more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Senior Data Engineer Python, SQL, Big Data FrameworksLondon, Geneva, Dubai - 4x a week (no flex)110-120,000 + bonusSeeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the … infrastructure that supports their cutting-edge trading strategies.Key Responsibilities:Design and manage scalable data pipelines.Integrate data from various sources and develop ETL processes.Optimize database systems for high performance.Work with data scientists and analysts to meet data needs.Automate data processing tasks … to enhance efficiency.Implement data security measures and ensure compliance with industry standards.Requirements:Master's degree in Computer Science, Engineering, Mathematics, or related field from a top uni.Proven experience as a Data Engineer in the financial services or hedge fund industry.Technical Skills:Proficiency in Python and SQL.Experience more »

new services? We are partnering exclusively with a large organisation to bring you an exciting opportunity for a highly skilled and experienced Lead Data Engineer to be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organisation. … other benefits. Flexible, hybrid working from Swansea with options for condensed hours. You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise … their digital services. This role will be instrumental in shaping their data infrastructure, ensuring it supports the strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions. Responsibilities: Leadership and Strategy: Lead the more »

new services? We are partnering exclusively with a large organisation to bring you an exciting opportunity for a highly skilled and experienced Lead Data Engineer to be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organisation. … other benefits. Flexible, hybrid working from Swansea with options for condensed hours. You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise … their digital services. This role will be instrumental in shaping their data infrastructure, ensuring it supports the strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions. Responsibilities: Leadership and Strategy: Lead the more »

Rivington Rd, Preston Brook, Runcorn, WA7 3DJ Salary: £46,000 - £49,000 Hours: 37.5 hours per week Are you a seasoned expert in data engineering looking to make a significant impact in the healthcare industry? Phoenix Medical Supplies is seeking a Senior DataOps Engineer to lead our data … services across the region. As a Senior DataOps Engineer, you will be instrumental in architecting and implementing solutions across the entire data pipeline, from ingestion to visualisation. The role will require you to showcase your skills in data ingestion, storage, modelling, transfer, hosting, visualisation, analysis … and consumption, all while mentoring and training team colleagues. Key Responsibilities: Design and develop robust data pipelines for ingestion, storage, processing, and interface creation. Produce both machine consumable interfaces and human consumable data products, including standard and ad hoc reports. Maintain and optimise data more »

proficiency in most areas of the professional function and in-depth specialization in some. Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Anticipates and prevents problems and roadblocks before they occur. Networks with senior internal and external personnel in own area … process, testing & operations Experience integrating third party SDK's like Facebook, Adobe etc Experience with integrating with Back-end Services (APIIs, GraphQL, etc.) Data & Analytics 4+ years experience in integrating, transforming and consolidating data from various structured and unstructured data systems for building analytics … technologies like Data Flow, Data Bricks, Azure Synapse, Azure Analysis Services and Power BI Analytics Experience in Data Pipeline and integration workflow management tools: Talend, Store Proc, Change Data Capture (CDC), Spark & Azure API's . click apply for full job more »

proficiency in most areas of the professional function and in-depth specialization in some. Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Anticipates and prevents problems and roadblocks before they occur. Networks with senior internal and external personnel in own area … process, testing & operations Experience integrating third party SDK's like Facebook, Adobe etc Experience with integrating with Back-end Services (APIIs, GraphQL, etc.) Data & Analytics 4+ years experience in integrating, transforming and consolidating data from various structured and unstructured data systems for building analytics … technologies like Data Flow, Data Bricks, Azure Synapse, Azure Analysis Services and Power BI Analytics Experience in Data Pipeline and integration workflow management tools: Talend, Store Proc, Change Data Capture (CDC), Spark & Azure API's . click apply for full job more »

proficiency in most areas of the professional function and in-depth specialization in some. Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Anticipates and prevents problems and roadblocks before they occur. Networks with senior internal and external personnel in own area … process, testing & operations Experience integrating third party SDK's like Facebook, Adobe etc Experience with integrating with Back-end Services (APIIs, GraphQL, etc.) Data & Analytics 4+ years experience in integrating, transforming and consolidating data from various structured and unstructured data systems for building analytics … technologies like Data Flow, Data Bricks, Azure Synapse, Azure Analysis Services and Power BI Analytics Experience in Data Pipeline and integration workflow management tools: Talend, Store Proc, Change Data Capture (CDC), Spark & Azure API's . click apply for full job more »

proficiency in most areas of the professional function and in-depth specialization in some. Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Anticipates and prevents problems and roadblocks before they occur. Networks with senior internal and external personnel in own area … process, testing & operations Experience integrating third party SDK's like Facebook, Adobe etc Experience with integrating with Back-end Services (APIIs, GraphQL, etc.) Data & Analytics 4+ years experience in integrating, transforming and consolidating data from various structured and unstructured data systems for building analytics … technologies like Data Flow, Data Bricks, Azure Synapse, Azure Analysis Services and Power BI Analytics Experience in Data Pipeline and integration workflow management tools: Talend, Store Proc, Change Data Capture (CDC), Spark & Azure API's . click apply for full job more »

proficiency in most areas of the professional function and in-depth specialization in some. Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Anticipates and prevents problems and roadblocks before they occur. Networks with senior internal and external personnel in own area … process, testing & operations Experience integrating third party SDK's like Facebook, Adobe etc Experience with integrating with Back-end Services (APIIs, GraphQL, etc.) Data & Analytics 4+ years experience in integrating, transforming and consolidating data from various structured and unstructured data systems for building analytics … technologies like Data Flow, Data Bricks, Azure Synapse, Azure Analysis Services and Power BI Analytics Experience in Data Pipeline and integration workflow management tools: Talend, Store Proc, Change Data Capture (CDC), Spark & Azure API's . click apply for full job more »

Senior Data Engineer (GCP) My client a financial services business are looking for a Senior Data Engineer (GCP), to spearhead global initiatives to migrate complex data systems to GCP. You will design, implement, and optimise data pipelines, ensuring data integrity … during migration and utilising GCP services for scalable and efficient data transformation. Salary: Up to £65K Hybrid: 2 days a week Key Responsibilities: Lead data engineering projects in Europe, working with partners for GCP transition. Design and deploy data pipelines with automated data … GCP. Essential Qualifications: 5 years of SQL. 3 years of GCP and its different services. Experience with microservice architecture and data processing pipeline design. Desired Qualifications: Certification in GCP. Financial Services experience. Experience coaching and mentoring data engineers. If this role is of interest, please more »

team reflective of society improves outcomes. We provide support for any needs or adjustments during the application process. Role Overview: As a Senior Data Engineer, your responsibilities include: Developing modern data systems and platforms to drive decision-making. Collaborating with clients to shape their data strategy. Enabling public sector organizations to adopt a data-driven approach. Owning and managing cloud infrastructure using a DevOps approach. Building data pipelines, handling various data types, and integrating error handling. Implementing data system architectures like Data Warehouse … Data Lakes, and Data Meshes. Creating reusable libraries for data pipelines and documenting end-to-end systems on a cloud environment. Adopting a robust DevOps approach and utilizing tools for DataOps. Ensuring software resilience through testing strategies and best practices. Applying SOLID, DRY, and more »

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as … having strong Azure Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake … framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

Data Engineer Our client based near Manchester is looking for a skilled Data Engineer to join their agile team. In this role, you'll play a pivotal part in designing, building, and maintaining data pipelines, ensuring the integrity and availability of data for various stakeholders, including BI Teams, Analytics, and Data Scientists. Responsibilities: Design, build, and automate data flow processes and ELTs to provide comprehensive data from business systems. Collaborate with product development teams to ensure best practices and data integrity from … source to destination. Assist in integrating data between systems, including third-party platforms. Write specifications and documentation for data processes. Continuously explore new solutions, tools, and processes to enhance data operations. Requirements: Bachelor's or Master's degree in Computer Science, related field, or more »

expertise, applies company policies and procedures to resolve a variety of issues. Works on problems of moderate scope where analysis of situations or data requires a review of a variety of factors. Exercises judgment within defined procedures and practices to determine appropriate action. Builds productive internal/external … Proven experience creating automation frameworks and tools to support test automation Experience working in a Microservices based architecture in a cloud native environment Data & Analytics 2 years of experience in integrating, transforming and consolidating data from various structured and unstructured data systems for building … with relational and NoSQL databases such as Cosmos, Cassandra 2 years of Experience in SQL, Java or Python programming Experience in Data Pipeline and integration workflow management tools: Talend, Store Proc, Change Data Capture (CDC), Spark & Azure API Experience identifying operational issues and recommending fixes more »

expertise, applies company policies and procedures to resolve a variety of issues. Works on problems of moderate scope where analysis of situations or data requires a review of a variety of factors. Exercises judgment within defined procedures and practices to determine appropriate action. Builds productive internal/external … Proven experience creating automation frameworks and tools to support test automation Experience working in a Microservices based architecture in a cloud native environment Data & Analytics 2 years of experience in integrating, transforming and consolidating data from various structured and unstructured data systems for building … with relational and NoSQL databases such as Cosmos, Cassandra 2 years of Experience in SQL, Java or Python programming Experience in Data Pipeline and integration workflow management tools: Talend, Store Proc, Change Data Capture (CDC), Spark & Azure API Experience identifying operational issues and recommending fixes more »