16 to 40 of 357 Big Data Jobs

Senior Data Engineer Hybrid AND Flexible Up to £75,000 + 10% bonus + share scheme MBN Solutions are delighted to have been retained to secure a Data Engineer (Big Data Technologies) for our client who are firmly positioned in the "Tech For Good" space. This … is a key hire for the client during the early stages of the growth of their Data team and it is therefore essential this person is highly experienced in all the areas of skills required. Our client are a start up/scale up and we are ideally looking … for a Senior Data Engineer who has previous experience and success in this environment previously. Your Role: Building reusable data pipelines at scale with the capability of integrating data from multiple sources automatically. Work with structured and unstructured data, and curate data to provide real more »

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business … Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency more »

Big Data Solutions Architect - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Big Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You … implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Excellence experience across Azure -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL … data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills Big Data Solutions more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … About the role As a Senior Software Engineer for this role, you will collaborate with the founding team to expand the integration of our Big Data processing acceleration technology with Apache Spark to drive new optimizations and broader SQL operation coverage. Your contributions to our core solution will … directly impact data infrastructure processing 10s of petabytes every day where Xonai is being deployed. Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility. What you will do: Implement extensible optimizations in various query more »

Contract/Permanent Opportunity Azure Cloud Data Architect Hybrid (London 2x per Week) Must have Active Security Clearance Job responsibilities Architecture of solutions Architecting Enterprise Data Platform on Cloud particularly on Azure to support regulatory financial institution Designing Functional Architectures for Service Quality Designing and maintaining Non-Functional … Requirements, e.g., Capacity planning, availability, performance, housekeeping, monitoring and foundational capabilities of the Enterprise Data Platform Designing the application solution delivery and good understanding of Cloud Infrastructure solutions Leading technical teams as appropriate in data and analytics delivery implementation and support Performing technical assessment and evaluation of Cloud … technical experience managing, developing and upgrading applications, within application/solution design Strong understanding of data modeling techniques in Relational, Document, Graph, and BigData platforms servicing OLTP, OLAP and mixed model architectures Excellent documentation skills and ability to complete high quality architecture artefacts in a timely fashion to meet more »

We are looking for Senior Data Solution Architect Below are details Data Solution Architect Proven experience as architect and engineering lead in Data & Analytics stream In-depth understanding of data structure principles and data platforms Problem-solving attitude, solution mindset with implementation expertise Working experience … on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Well-versed with the end2end data management philosophies and governance processes Has pre-sales experience and have involved in RFP/RFI/RFQ processes Creative problem-solver with strong communication skills Excellent understanding of traditional … and distributed computing paradigm Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have strong implementation experience in all more »

Data DevOps Engineer - DevOps, Big data - Permanent - Gloucestershire Location: Gloucestershire/Bristol (full-time onsite) Salary: £65 - £95K per annum Negotiable DOE Benefits: Flexible working hours, career opportunities, private medical, excellent pension, and social benefits Active DV Clearance is highly desirable. Please note that candidates will need … with a global edge-to-cloud company advancing the way people live and work. They help companies connect, protect, analyse, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today … The Candidate: We are looking for a bright, driven, customer focussed professional to join our clients Hybrid Cloud Delivery team, and work alongside Enterprise Data Engineering Consultants to accelerate and drive data engineering opportunities. This is a fantastic opportunity for a dynamic individual with big ambitions, who more »

JOB TITLE: Lead Data Architect (Cloud) SALARY: The salary banding for this role is £121,023 - £142,380 LOCATION: Manchester, Leeds, Halifax, Bristol or Edinburgh HOURS: 35 hours, full time WORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week, or 40% of … T' shaped): Cloud platform technologies covering IaaS, PaaS, and SaaS services on Azure, GCP and AWS. Cloud database technologies focusing on GCP Relevant prior data architecture experience; Leading or being part of transformation in Data (e.g., move to advanced analytics/machine learning, data lake, big data, data democratisation) Data modelling and how that can help accelerate reuse of data and delivery of data consumption use cases Modern data technologies understanding e.g. Machine Learning and Generative AI Experience with data management capabilities like metadata, lineage, data quality more »

service, partner with Deutsche Bank to support contingent recruitment processes. Job description - the role On behalf of Deutsche Bank, we are looking for a Data Governance Analyst for an initial 6 month contract based in the Banks London Office on a hybrid working model of 3 days per week … tasks. 'Together we're sharing new perspectives and transforming what it means to be a bank.' Purpose of the role: Transaction Monitoring & Screening Global Data Steward Office is responsible for Data Governance, Data Quality Management (DQM) & Data Programme delivery covering key functions within Transaction Monitoring and … Screening. Working as part of the DQM team the Senior Data Analyst will be responsible for supporting the Data Quality Management Framework and for contributing towards the central Data Analytics capability. Data Quality Management Framework covers Data Quality Standards, Data lineage & Controls, Exception & DQ more »

Data Engineer – Hybrid (3 days in Office) Stratford-Upon-Avon £56k + 5% bonus & benefits Do you want to grow your expertise and experience and use your skills in a vibrant environment where teamwork, creativity, diversity, inclusivity, and technical excellence are expected and enjoyed? This SaaS company are seeking … from associates to principals, applying your technical and problem-solving capabilities to scale their applications. You’ll contribute to the organisation’s high-quality data engineering practices, participating in technical design, implementation, testing, deployment, and ongoing support and maintenance of the data platform. By going above and beyond … implementing new features, the company focus on customer experience, building a high-quality, secure, and scalable data platform. You'll apply your skills effectively and continue to develop them, while benefiting from the expertise of your more experienced colleagues, including: Pair and mob-programming. Peer code reviews. Modern big more »

a talented Senior Software Engineer with expertise in orchestrating end-to-end solutions from "curb to gate" while leveraging AWS, Python, Node.js, Kafka, and Big Data technologies. Job Description: As a Senior Software Engineer specializing in _Curb to Gate_ solutions, you will play a pivotal role in designing … and deploying robust software systems that orchestrate seamless user journeys from entry point to destination. Leveraging your expertise in AWS, Python, Node.js, Kafka, and Big Data technologies, you will contribute to the creation of scalable and efficient solutions that enhance the overall user experience. Responsibilities: - Architect and develop … Develop backend services and APIs using Python and Node.js, ensuring high performance, reliability, and security. - Implement event-driven architectures using Kafka for real-time data processing and communication between microservices. - Utilize Big Data technologies (e.g., Apache Spark, Hadoop) to process and analyze large volumes of data more »

and brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business Intelligence, Analytics and Data Science. Develop and optimise large-scale data pipelines that ingest data from a variety of sources Work in a dynamic and exciting agile team with a highly skilled team of Data Engineers from other disciplines to design and develop innovative data-driven solutions Comfortable with more »

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global Pharmaceutical Services … provider Description This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. You will work … on designing and developing their company data acquisition strategy allowing for near real time process reporting and full support of contractual reporting to customers. Key Responsibilities: Monitor and maintain ETL processes to ensure the continuation of an accurate data reporting platform for the business. Explore solutions for optimising more »

Senior Data Engineer Snowflake data cloud Birmingham, West Midlands - Hybrid role 70k plus mostly remote working Snowflake, SnowPro, DV2, Data Vault 2.0, Cloud Data Platform The Data Developer will play a key role in the architecture, design, and management of data solutions within the … Snowflake Data Cloud. You will lead a team of Data Developers on the Snowflake Cloud Data platform, providing invaluable technical guidance and mentorship, where you will collaborate seamlessly with cross-functional teams to ensure their data solutions align seamlessly with their business goals. The Data specialist must have a Snowflake certification , either/or; SnowPro Core, SnowPro Advanced Data Engineer or SnowPro Advanced architect etc Experience and Skills: Extensive experience as a Snowflake Engineer, with a focus on data architecture and optimisation. Proven leadership experience, including mentoring and guiding a team of more »

Power BI developer 6 months contract – Competitive market rates – Inside IR35 - London – 3 days on-site Key Skills: Python, Power BI, SQL, Experience with Big Data pipelines, DAX, Excel, Financial services background The Role: A global trading organisation is looking a Python/Power BI to join their … Data and Business Service team to become accountable for detailed design and delivering solutions. This person will be working with the business helping to build Apps using Python and Power BI for the output dashboards. Key Responsibilities: Develop and construct data pipelines to facilitate efficient extraction, transformation, and … loading of data from diverse sources. Create and implement Business Information Access portals, comprising dashboards and reports, utilizing PowerBI. Collaborate with business stakeholders to comprehend the Data Virtualization layer, ensuring continued deployment and enhancements. Innovate existing solutions and forecast future demands to meet evolving business needs. Develop analytics more »

AWS Data Engineer - Insight & Data Services - Permanent Salary guideline: £75,000 - £95,000 pa (D.O.E) + 5-10% Bonus, Pension up to 6% Contributory, Health Insurance, Life Assurance etc. Base Location: Closest office to your home location/Hybrid working/Part Remote/UK-wide The Client … Our client's Insights and Data practice is the leading Data Science and AI Engineering provider in the United Kingdom with over 450 consultants serving the UK market. They are the true market leader! The Role: As an AWS Data Engineer within the Insights & Data Emerging … fantastic? Do you want to be at the forefront of the AI revolution? The Focus of the Role: We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: * Design and build data engineering solutions and support the planning and more »

Analytics Advanced Specialisation. Adatis is now part of Telefonica Tech as of March 2022, powering the next phase of our growth. We’re a Data Analytics Consultancy that works with our clients to deliver information solutions, to help make better informed business decisions. Our integral approach within our team … that people really love; and, importantly, a career model that lets you take control of your development and progression. OUR VISION To be the data analytics company most admired for its people, culture and innovation. THE ROLE The primary focus for you will be the design and delivery of … enterprise-level data solutions from the earliest discovery phases of projects through prototyping, architectural design and delivery. You will be working with Azure tools such as Databricks, Data Factory as well as Hadoop to create big data environments which, in turn, will help businesses to gain more »

Big Data Architect - Hybrid - £110K My client is a global telecommunications company that are looking to add a talented Big Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You'll … implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Great understanding of Cloud e.g. Azure and or AWS -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark … etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills more »

Data Models Lead - Data Engineering - MarTech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »

We are looking for an apprentice Data Technician, who will start by working on our Reception with scope to progress throughout the business as they progress through their training programme in areas such as Marketing and Data Analysis. Role Duties of the role will include: Collect relevant data regarding candidates and add to their profiles Complete Character and employment references for former and current candidates using the data we have on our systems Create tables and spreadsheets to hold data that is requested Direct candidates to meeting rooms, if invited for meeting and offer drinks … using our internal systems Add compliance to profiles for the account managers Training Successful completion of this apprenticeship gives you an accredited Level 3 Data Technician qualification. The qualification has core knowledge elements including but not limited to: Intro to Data Analytics Big Data Tools Data more »

An experienced Cloud Data Engineering Manager with at least 2-3 years of managing data engineering experience is needed to join the team at this rapidly growing Data Analytics Consultancy based in Oxford. You will be excited to play a pivotal role in leading their cloud engineering … your career with a well-established company! About the Company Founded in 2014 and based in Oxford, UK, this dynamic analytical consultancy specialises in data analysis, statistical modelling, and various analytical techniques like BI and Risk Management. They provide businesses with custom, secure solutions, primarily working in the cloud … AWS and GCP to process and analyse large volumes of client data. About the Role They are seeking a highly skilled and experienced Cloud Data Engineering Manager to manage their data engineering team in designing, implementing, and maintaining scalable cloud-based data solutions tailored to meet their more »

We are looking for a skilled Data Engineer with a strong background in Microsoft CRM to design, develop, and maintain our data pipelines and analytics solutions. The ideal candidate will have a passion for leveraging data to drive business outcomes and will be adept at working with … complex datasets and integrating data from various sources. Key Responsibilities: Data Pipeline Development: Design, build, and maintain scalable and efficient data pipelines to extract, transform, and load data from Microsoft CRM and other relevant sources. Data Integration: Integrate data from Microsoft CRM with other … internal and external data sources to create a unified view of customer interactions, sales performance, and other key metrics. Data Modeling: Develop and implement data models to support reporting, analytics, and business intelligence initiatives, ensuring data accuracy, consistency, and reliability. Performance Optimization: Identify and implement optimizations more »

Responsibilities: As a pivotal member of our rapidly expanding business, your role involves: Designing and Maintaining Data Architectures and Pipelines: Create and optimize robust data architectures and pipelines. Assemble intricate data sets that align with both functional and non-functional business requirements. Identify opportunities to acquire new … data from various systems. Enhancing Processes: Develop and refine data set processes for effective data modeling, mining, and production. Build the necessary infrastructure for seamless data extraction, transformation, and loading from diverse data sources. Data Reliability and Efficiency: Recommend and implement strategies to enhance … data reliability, efficiency, and quality. Collaborate with Data Scientists and Machine Learning Engineers to construct analytics tools that leverage the data pipeline. These tools provide actionable insights related to asset management, operational efficiency, and other critical business metrics. Cross-Functional Collaboration: Work closely with stakeholders, including Product more »

orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Data Architect 6 months £650 per day (Inside IR35, via Umbrella) Warwick (Hybrid) 2 days a week in Office My client is the largest independent … utility supplier in the UK. This is an excellent chance to join a fast-moving big data project. Job role: To lead on the design and implementation of data structures to integrate BIM implementation project data to meet the operational needs of the client. To deliver … strategies that drive consistent robust and effective approaches to data and its quality. Manage the programme of works to deliver data quality improvements and ensure appropriate controls are in place in line with the clients data management standards. This role will lead through his/her proven more »

Power BI Developer that has a strong background in Python and Power BI to join the Software Delivery team to strengthen the power of data within the business. The company is moving its data from legacy stores to a strategic data warehouse and data lakes to … standards, coding standards, and tools, while also working collaboratively with the team by utilising communication and problem solving skills. Key responsibilities: Ability to build data pipelines that will allow optimal extraction, transformation, and incorporation of data from various data sources. Be able to utilise Power BI to … build dashboards and reports. Understand the Data Virtualisation layer and partner with the Business for continued deployment and Business enhancements. Improve solutions and be able to anticipate where the demand is for the business. Build analytics tools that utilise the data pipeline to provide key insights for various more »