201 to 225 of 371 Data Pipeline Jobs

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Amazon Redshift, Amazon EMR, Amazon Athena, Amazon Sagemaker and more. Help our customers to remove the constraints that prevent them from leveraging their data to develop business insights Create white papers, writing blogs, build demos and other reusable collateral that can be used by our customers. Work closely … with our Solution Architects, Data Scientists and Service Engineering teams Experience with design, development and operations that leverages deep knowledge in the use of services like Amazon Kinesis, Apache Kafka, Apache Spark, Amazon Sagemaker, Amazon EMR, NoSQL technologies and other 3rd parties Develop and define key business questions … needs of enterprises Basic understanding of machine learning fundamentals Ability to take Machine Learning models and implement them as part of data pipeline IT platform implementation experience Experience with one or more relevant tools ( Flink, Spark, Sqoop, Flume, Kafka, Amazon Kinesis) Experience developing software code in one more »

Eames Consulting are delighted to be supporting an established Investment management company that are looking for a Data engineer. Responsibilities: Develop and maintain complex SQL queries, customize reports, and optimize data usage. Create tools to address business challenges and empower users with third-party tools. Design … and implement cloud-based data platforms, ETL pipelines, and data integration. Collaborate with colleagues to ensure data integrity, quality, and security standards are met. Experience required: 3 years experience working as a Data engineer or similar Strong proficiency in SQL or Data Bricks and database development, including complex query optimization and performance tuning. Comfortable using programming languages such as Python Strong Data Warehousing experience - building data pipelines from scratch Good understanding of open source, big data, and cloud data platforms (e.g. AWS more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal … role in constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions … contact us at 0161 438 1178 for more information. Key skills; AWS Data Engineer, AWS Cloud, Python, SQL, AWS, Glue, ETL Pipelines, Data Engineer, Birmingham, West Midlands Follow us on Twitter @erinassociates for updates on similar opportunities. Erin Associates Ltd is an equal opportunity employer. more »

Data Engineer Our growing client based in Manchester is currently looking for a skilled Data Engineer to contribute to the development of our clients' cloud-native data platform in AWS. In this role, you'll collaborate with stakeholders to architect and implement data solutions that drive business outcomes. Responsibilities: Collaborate with stakeholders to translate requirements into scalable data solutions. Architect and oversee the migration to a cloud-native data platform in AWS. Utilise Agile methodologies to manage the development lifecycle. Design and implement data pipelines … ensuring data quality and integrity. Requirements: Proficiency in ETL tools such as SQL, SSIS, AWS, Lambda, and Python. Strong understanding of data warehouse concepts. Excellent problem-solving and communication skills. Benefits: Competitive salary and benefits package. Opportunities for career growth and development. Collaborative and inclusive work more »

digital avatars and human clones. Role: MLOps Engineer Location: London Salary: Up to £100,000 Responsibilities: Develop ML Pipelines: Build and maintain scalable data processing systems. Ensure data quality and integrity. Automate ML Processes: Integrate machine learning solutions into existing systems and automate workflows. Deploy and … implementation practices. Ensure Security: Adhere to security and compliance standards in ML deployments. Requirements: Education: Bachelor’s or Master’s in Computer Science, Data Science, or related field. Experience: 2-3 years in ML, data engineering, or MLOps. Abilities: Strong analytical, problem-solving … and communication skills. Skills: Proficient in Python, ML frameworks like TensorFlow or PyTorch. Experienced with CI/CD, Docker, Kubernetes, and data pipeline tools like Airflow. more »

Data Engineer Location: London, UK Hybrid: 3x a week in office Salary: £63,000 About the Client Our client is a top-tier professional services firm known for its exceptional workplace culture and some of the most sought-after office spaces in London. Role Overview Our client is … in search of a skilled Data Engineer to manage and engineer the data warehouse. The opportunity will be amazing for a Data Engineer who is happy to work in a small team. Incredible opportunity to mentor/lead a small Data Engineering … team within a year! Main Responsibilities Build scalable data pipelines on a daily basis Code on a daily basis with Azure SQL and python Develop and maintain the logical and technical architecture to fulfil the client’s information, insights, and reporting needs. Stay informed on the latest developments more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … policies. Essential Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. … Building Azure data pipelines. Agile methodology experience. Problem-solving skills. Awareness of industry trends. Stakeholder engagement. Desired Experience Business Objects Reporting. Power BI familiarity. more »

Omni client solutions. These solutions are major differentiators that puts Omnicom ahead of the competition. Specific responsibilities of the team are listed below. Data Taxonomies design & maintenance Data Governance and QA Dashboard design, build and maintenance Data Pipelines design & delivery TW/Planit (& TrackIT … for maintaining and improving tables and business logic for a reporting platform. The Business Intelligence Manager will support an MI Director with all data operations and reporting workstreams for one of Omnicom’s largest global autotive clients and work closely with our engineering team; TSOC. This role will … ensure our AWS data infrastructure is supporting a best-in-class reporting platform for one our our largest accounts within Omnicom Media Group, and will be reporting into the Senior Marketing Intelligence and Reporting Director. Communication skills and the ability to prioritize tasks across projects to meet deadlines more »

Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability … and efficiency. Key Responsibilities: Design, develop, and maintain scalable data pipelines using BigQuery, Python, and CloudRun. Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions. Implement best practices for data modeling, ETL processes, and data governance. Optimize and fine-tune data processes to improve performance and reliability. Stay up-to-date with the latest technologies and trends in data engineering and recommend innovative solutions to enhance our data infrastructure. Required Skills: Strong proficiency in BigQuery, Python, and more »

Data Scientist/Quant Researcher Top-tier Hedge Fund London/Hong Kong Our client, an industry-leading hedge fund, is looking to add Data Scientists to its Equities division. We will be hiring in both London and Hong Kong. You will be an early/… mid-career Data Scientist (1-7 yrs' experience) currently working in a: Hedge Fund Asset Manager Market Data Provider Alternative Data Provider or adjacent industry with exposure to Capital Markets data You should ideally have an interest in a particular Equities sector … or group of sectors (e.g. Consumer data, Healthcare data, etc) and some proven expertise in applying this to Equities markets problems. Working with the firm's world class technologists and investment teams, you will be an individual contributor focused on the analysis of 3rd party data more »

At AX, we are looking for a Data Engineering Lead to join our dynamic team. As the Data Engineering Lead you will have a strong background in data analysis, team management, and expertise in utilizing various Microsoft BI tools and cloud-based technologies including … SSRS, SSIS, SSAS, Azure Synapse, Azure Data Factory and lakes and curated business models. A little bit about us AX is an accident assistance and after care service provider who deliver replacement vehicles to customers who have been involved in non-fault accidents. We pride ourselves on keeping … and engaging with our colleagues is fundamental to ensure we provide an industry leading service to our partners and our customers. As our Data Engineering Lead, your responsibilities will include: Team Leadership Provide leadership, guidance and support to team members, ensuring the successful execution of projects and tasks. more »

Sheffield, mainly remote or something in-between, believe that your best work happens when you have the freedom to create your ideal workspace Data Scientist Salary: £30-50,000 Location: UK - Remote/Hybrid/Sheffield HQ Twinkl is embarking on an exciting journey, and we're at … the beginning of something extraordinary. As we reshape the future of educational resources, data-driven decisions will be at the heart of our transformation. Join our team of over 20 data enthusiasts and contribute to shaping what the future of learning looks like! Why You'll … of education We are a high-spirited, conscientious team that celebrates inclusivity and where work is rewarding and fun! Your Role: As a Data Scientist, you're not just crunching numbers - you're influencing the educational landscape. Our work ranges from ensuring the entire business has the data more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal … role in constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions … to drive data-centric decision-making, and upholding data quality and organisation standards. Strong skills in Python, SQL, AWS, Glue, ETL and DataOps principles is essential. Core skills: Strong coding skills in Python & SQL Excellent experience in the AWS Cloud platform, including AWS Glue, Amazon DynamoDB more »

Dynamics), coupled with strong skills in building custom solutions on AWS, proficiency in API development using languages like Python, and some experience in data engineering. The ideal candidate will play a key role in designing, developing, and optimizing Martech solutions to drive marketing effectiveness and customer engagement. The … of martech platforms such as Adobe AEP or similar to support marketing campaigns and initiatives. Configure and integrate platform components to enable seamless data collection, segmentation, personalization, and campaign orchestration. Custom Solution Development: Architect, develop, and deploy custom solutions on AWS to extend the capabilities of martech platforms … and address specific business requirements. Utilize Python and other relevant programming languages to build robust APIs, microservices, and integrations for seamless data exchange and automation. Data Engineering: Apply data engineering principles to design and optimize data pipelines for ingesting, processing, and analyzing more »

Job title: Data Engineer Client: Elite Quantitative Trading Firm Salary: Up to £1500 p/d Location: London/Hybrid My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction … transformation, and loading (ETL) processes from a variety of sources, including websites, PDFs, and real-time data streams. Being a Data Engineer at a truly tech driven fintech, you will join an environment that prides themselves on working with the most cutting edge technologies and boast … a world class technical team where you will work with and learn from the best. Responsibilities: As a Data Engineer, you will design, build and continuously optimise extremely scalable and performant data pipelines. Architect and implement data ingestion, transformation, and storage processes. Develop and more »

Business Development Manager - Data Solutions Stride Recruitment is working with a leading data consultancy focused on delivering Data & Analytics Solutions for clients in markets such as; Financial Services, Retail, CPG, and Telco. They specialise in the delivery of Modern Data Solutions for … firms in their chosen target markets. Using innovative technologies, they deliver data pipelines, cloud data architectures, advanced analytical and AI/ML solutions. We are looking for ambitious and self-motivated sales professional with a passion for helping customers achieve more with Data, Analytics … Demonstrated ability in negotiating high-value contracts with a track record of successful deal closures. Analytical Mindset: Strong analytical skills to understand complex data environments and articulate the value proposition of our solutions effectively. Technological Proficiency: Familiarity with the latest trends in data analytics, machine learning more »

Are you a Data Engineer with a passion for engineering various data tools ? We would love to hear from you! Careers at TCS: It means more. TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. … you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation. Be exposed to the future of data Work with some of the brightest global minds in the industry Lead definition and implementation of standards and best practices in Enterprise The Role … This role will support the design, management, checking, and engineering of a diverse range of data using a variety of tools to achieve consistent data sharing across the organization. Your Profile Key responsibilities: Design, create, test and maintain data pipelines to support Digital projects more »

A global company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team based in their London office – this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It’s a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having recently launched a brand-new Azure Data Platform and introduced the use of Databricks. The role is predominantly back-end Data Engineering focused, where you’ll develop … various solutions for data collection, integration, transformation and modelling, to support the ongoing development of their global data platform. This will include developing data pipelines, to automate data collection and integration across various sources, with the use of Azure Data more »

Graduate Data Engineer - Fast Growing FinTech A very fast scaling FinTech in London are looking for a talented Data Engineer to join their team. In this role as a Data Engineer you’ll work with extremely high calibre engineers and hit the ground running … with where you have the most experience and then gaining exposure to the rest of their services to build out your expertise. Graduate Data Engineer - About You On track for a First from a Top Russel Group University Self-starter who thrives in challenging environments A background in … a relevant field (Computer Science, Physics, Mathematics) with Software internships or projects Demonstrable experience in Python and SQL Data Engineer Desirable Qualities: Ability to communicate effectively to technical and non technical people Nice to haves includes: Kubernetes, Docker, BigQuery, Cloud, Databases Interest in FinTech Data Engineer more »

consultancy that are recruiting SECURITY ARCHITECTS to work on a very exciting LONG-TERM CONTRACT within the financial service sector. Role: Security Architect (Data Solutions) Rate: Up to £500 per day (inside IR35) Location: Swindon/London Hybrid (2 days onsite) Duration: 6 months (initially view to extend … integrations team, you will play a crucial role in ensuring the security and integrity of systems related to service mesh, container platforms, and data solutions. Your responsibilities will involve designing, implementing, and maintaining robust security measures to protect sensitive data, prevent unauthorized access, and mitigate risks. … Key responsibilities: Collaborate with development and operations teams to design secure and scalable architectures for containerized applications, data mesh, and Kafka. Assess and implement security controls for container platforms (e.g., Kubernetes, Docker). Define and enforce container image security practices, including vulnerability scanning, image signing, and runtime security. more »

consultancy that are recruiting SECURITY ARCHITECTS to work on a very exciting LONG-TERM CONTRACT within the financial service sector. Role: Security Architect (Data Solutions) Rate: Up to £500 per day (inside IR35) Location: Swindon/London – Hybrid (2 days onsite) Duration: 6 months (initially – view to extend … integrations team, you will play a crucial role in ensuring the security and integrity of systems related to service mesh, container platforms, and data solutions. Your responsibilities will involve designing, implementing, and maintaining robust security measures to protect sensitive data, prevent unauthorized access, and mitigate risks. … Key responsibilities: Collaborate with development and operations teams to design secure and scalable architectures for containerized applications, data mesh, and Kafka. Assess and implement security controls for container platforms (e.g., Kubernetes, Docker). Define and enforce container image security practices, including vulnerability scanning, image signing, and runtime security. more »

Our client who is a house hold UK name branded business are urgently looking for a Data Engineering Manager to lead a small team of data engineers. Responsibilities: Manage a team of data engineers. (must have managed before, not looking for senior data engineers looking to make the next step. Oversee the design, development, and maintenance of data pipelines. Collaborate with cross-functional teams to ensure data quality and availability. Lead projects related to data integration, transformation, and storage. Implement best practices for data engineering processes. Requirements: Previous experience managing a team of data engineers. Proficiency in Azure (including services like Azure Data Factory, Azure Databricks, etc.). Strong programming skills in Python . Familiarity with data modeling, ETL processes, and data warehousing. Excellent more »

Data Engineer - Belfast - £55 - 60k + Bonus Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting … learning and diversity at all levels. They have a new opportunity for a Data Engineer to join their Digital function. AWS is a huge growth area for this company, so it's a great opportunity to really develop your cloud skills. The person Experienced in designing and deploying … production data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Knowledge of data cleaning, wrangling, visualization and reporting more »

support of BTs Strategic SIEM development. We are seeking a skilled Software Engineer with expertise in Elasticsearch (or other SIEM and/or Data platforms) to join our dynamic team. As a Software Engineer you will play a critical role in designing, developing, and maintaining our security information … will be on leveraging Elasticsearch and related technologies to enhance threat detection, incident response, and overall security posture. What you’ll be doing • Data Ingestion and Enrichment: o Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka o Enhance data enrichment … Lead for the year and work towards achieving these. You'll have the following experience • ETL Processes with Logstash Design, develop, and maintain data pipelines using Logstash, part of the Elastic Stack. Automate data ingestion, transformation, and loading tasks. • Beats for Data Collection Configure more »