1 to 25 of 498 Big Data Jobs

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

xperience and Education Required Approximately 10 years of industry experience implementing data integration tools such as Microsoft SSIS, Azure Data Factory, Databricks, Glue, Step Functions, Airflow, Apache Flume/Sqoop/Pig, and similar technologies. 3–5 years of team management experience. 3–5 years of consulting experience … preferred). Minimum of 5 years’ experience in data architecture, data modelling, or related disciplines. Bachelor’s degree or equivalent experience required; Master’s degree preferred. Strong knowledge of data warehousing, OLTP systems, data integration, and the software development lifecycle (SDLC). Hands-on experience with ...

week Department: IT Type: 3-month rolling contract Outside IR35 Position: Analytics Engineer The organisation is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven … decision-making. Key Responsibilities Design and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including ...

company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (AWS/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big … Data Administrator (AWS/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our big data platform in AWS cloud Manage and maintain services in Cloudera on-cloud PaaS & AWS-native like Kafka, Flink, NiFi, Iceberg Tables & DynamoDB IaaC deployment in AWS cloud via Terraform & ArgoCD Update, upgrade ...

Hiring on behalf of a multi-strategy, multi-manager hedge fund is looking for a Data Architecture Lead to join their team. The firm trades globally across multiple asset classes and investment approaches. The primary focus of this role will be on the buildout and operations of a next … generation security master system. In addition to designing and implementing robust data architectures. The successful candidate will lead the security master development team, overseeing the quality, performance, and scalability of the teams’ deliverables. Key Responsibilities – Data Architecture and Design: Lead the design and implementation of the enterprise data ...

Purpose of position Data sits at the heart of the company. This role ensures that Awin can fully leverage the data available across the group, enabling the development of robust reporting capabilities that support stronger commercial decision making and elevate campaign management for client facing teams. … work effectively both independently and within a team, and contribute proactively to improving engineering standards and working practices. You possess a deep understanding of data and business requirements and can translate these into clear technical specifications. You write clean, maintainable, and high quality code, and you are capable ...

closely together. The team collaborates closely with UX and Product to design, build, and deliver high-quality features efficiently and reliably. SciVal is a data-driven product that provides academic and research metrics to customers, enabling insight, analysis, and informed decision-making. The team focuses on building scalable, reliable … solutions while continuously improving usability, performance, and data accuracy. About the role: Acts as the technical lead and facilitator for a cross-functional squad. In addition to hands-on design, coding, and/or test automation, this role sets technical direction, shapes delivery plans, drives quality strategy, and unblocks ...

inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Senior Data Engineer Role Description We are seeking a skilled and experienced Senior Data Engineer with a strong focus on Databricks to join our team. … candidate will have expertise in Python/Pyspark, CI/CD pipelines, and hands-on experience with Databricks to design, implement, and optimize scalable data solutions. This role will be based in our Guildford office with office attendance expected fortnightly on a Wednesday. Salary Information Pay: Circa ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise … data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage … DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will join a multidisciplinary group of data and platform specialists who deliver modern cloud-based transformation for clients across a range ...

designs Identify quality issues related to ISI product, including instruments, accessories, and software subsystems and hardware Drive resolution of product quality issues through data analysis, reporting, and change advocacy The successful candidate will become a subject matter expert in customer use of ISI product, failure modes … companies across the country. We collaborate with clients to design, develop and implement business-driven technology solutions. We have deep domain expertise with multiple big data platforms and have strong partnerships with industry leaders in the space. The founders have over 40 years of experience helping clients ...

designs Identify quality issues related to ISI product, including instruments, accessories, and software subsystems and hardware Drive resolution of product quality issues through data analysis, reporting, and change advocacy The successful candidate will become a subject matter expert in customer use of ISI product, failure modes … companies across the country. We collaborate with clients to design, develop and implement business-driven technology solutions. We have deep domain expertise with multiple big data platforms and have strong partnerships with industry leaders in the space. The founders have over 40 years of experience helping clients ...

employers actively hiring across these roles. Job Description: UK-Based (On-Site, Hybrid or Remote) About the Role We're looking for experienced Data Engineers at all levels—from Data Engineer through to Senior, Lead, Principal, Analytics Engineer and Data Platform Engineer positions—for upcoming roles across … data pipelines, warehouses, lakehouses and the platforms that data teams depend on. These are hands-on engineering roles where you'll build and operate the foundations that analytics, BI, data science and ML all stand on. You'll work across the full data engineering lifecycle—from ...

About the Job you are considering: Results-driven Hadoop Data Engineer with experience designing, developing, and maintaining large-scale data processing solutions for financial services organizations. Skilled in building robust data pipelines, managing big data platforms, and transforming high-volume structured and unstructured financial data into actionable insights. Proficient in Hadoop ecosystem technologies including HDFS, Hive, Spark, Sqoop, Kafka, Oozie, and YARN , along with SQL and cloud-based data platforms Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those ...

ESSENTIAL ROLES & RESPONSIBILITIES Identify and understand customer data-centric use cases within regulated financial services environments Design and implement data ingestion, processing, and transformation pipelines on Azure Build and maintain data pipelines for cleaning, normalisation, enrichment, and preparation Apply appropriate data modelling techniques and architecture patterns … with a strong focus on medallion architecture Orchestrate, monitor, and optimise Azure Databricks jobs and Azure Data Factory pipelines across development, UAT, and production environments Configure platforms, clusters, and compute resources to optimise performance, cost, and reliability Use automated CI/CD pipelines to manage, deploy, and version data ...

Data Engineer Bristol | Hybrid (3 Days Onsite) Salary + Benefits - £60,000 to £71,000 + 10% bonus, 33 days holiday, pension, health Career Progression + Modern Tech Stack Pyspark | ML | AI | Databricks | Kafka | AWS Are you a Data Engineer with strong Python, SQL and PySpark skills … opportunity to step up and accelerate your career? We're partnering with a market-leading technology business that is investing heavily in its data platform and is at the forefront of innovation within the smart housing sector. Processing billions of sensor readings every month, they're looking ...

implementing new controls and monitoring mechanisms, owning and remediating journal entry failures, and leading efforts to automate and improve revenue processes. This role leverages big data and advanced analytics to provide actionable insights. Key Accountabilities Forecast vs. Actual Revenue Analysis Compare forecasted revenue to actuals across services, contracts … performance affects profit margins and overall P&L. Volumetric & P&L Variance Analysis Analyze large datasets to detect usage anomalies in energy usage, meter data, and billing. Quantify the financial impact of volumetric variances on revenue and cost structures. Translate technical findings into business language for P&L reporting ...

Data Scientist Salary up £60,000 + Benefits Hybrid | London We've partnered with a large, established business to find a Data Scientist who will help translate complex data into insights that drive real commercial decisions. This is an organisation with significant scale and a growing focus … data and digital capability. You'll sit within a dedicated data function, working closely with a Senior Data Scientist and collaborating across engineering, product and business teams to build models that get used, not just presented. Responsibilities as a Data Scientist: Conduct exploratory data analysis ...