151 to 175 of 687 Big Data Jobs

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

We are seeking an experienced Solution Architect Data Focus to join our innovative team in London, United Kingdom. This is a hands-on architecture role for someone who brings deep expertise in data and database design, but who also operates as a solution architect across projects and pre-sales. They'll lead architecture work in both client-facing … like discovery and opportunity shapingalways with a sharp lens on how to manage and leverage data. They'll be the person the team turns to for strategic thinking around data flows, storage, security, analytics platforms, and the architectural design of data-heavy systems. Develop and own solution architectures, especially for projects with complex data requirements. Ensure all … designs meet Endava and client standards for performance, security, and scalability. Translate non-functional requirements (NFRs) into technical designs. Lead on data architecture directioncovering modelling, database strategy, data flows, and integration patterns. Guide data governance, retention, and compliance practices (e.g., GDPR, ISO standards). Technical Design & Development Oversight Define storage, publishing, and metadata strategies to support analytics More ❯

Active Top Secret with SCI eligibility and CI Polygraph Benefits: 100% employer-paid healthcare Role Overview: Join to work on challenging projects in software engineering. Collaborate with stakeholders and Data Analysts to develop capabilities that support mission success. Handle ETL processes and Big Data using Spark/PySpark. Key Responsibilities: Understand and generate requirements based on customer … needs. Work with various data types (Technical Telemetry, Cyber data, telecommunication protocols). Update application workflows for better performance and resiliency. Collaborate in a multi-faceted team to maintain software applications with a big-data footprint. Solve unique intelligence problems for special operations analysts. Engage in prototyping and iterative feedback. Qualifications: Bachelor's in Computer Science … years of development experience (Python and Java) Preferred Skills: Full-Stack Web Frameworks: Django, Flask Front-End Frameworks: React, Angular, Typescript Cloud: Openstack, AWS, Azure DevOps: Docker, Ansible, Gitlab Big Data: Spark, Elasticsearch, Hadoop, Neo4j Geo-Related Mapping Experience Apply today to make a real impact with cutting-edge technology and innovative solutions More ❯

an office in Central London and work as a mix from office and home. The role We are looking for a senior Machine Learning Engineer with a spike in data engineering and maintaining real-time data pipelines. You will work with our Product & Engineering team along the end-to-end algorithm lifecycle to advance the Trudenty Trust Network. … A bit more on what youll do: Data Engineering Develop and maintain real-time data pipelines for processing large-scale data Ensure data quality and integrity in all stages of the data lifecycle Develop and maintain ETL processes for data ingestion and processing Algorithm Development, Model Training and Optimisation Design, develop, and implement advanced … algorithms for fraud prevention and user personalization Train and fine-tune machine learning models using relevant datasets to achieve optimal performance Implement strategies for continuous model improvement and optimization Data Mining & Analysis Apply data mining techniques such as clustering, classification, regression, and anomaly detection to discover patterns and trends in large datasets. Analyze and preprocess large datasets to More ❯

Python, Java, AWS Infrastructure, Linux, Kubernetes, Hadoop, CI/CD , Big Data Platform, Agile, JIRA, Confluence, Github, Gitlab, puppet, ansible, maven, virtualization, ovirt, proxmox, vmware, Shell/Bash scripting Due to federal contract requirements, United States citizenship and an active TS/SCI security clearance and polygraph are required for the position. Required: Must be a US Citizen. … Would be Nice to Have: Bachelor's or Masters degree in computer science or related discipline from an accredited college or university. Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g. Cloudera's Distribution of Hadoop, Hortonworks Data Platform, MapR, etc ) is a plus. Experience with CI/… considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law. The benefits package: • Affordable healthcare options with 80% employer paid premium PLUS a company-funded HSA • Dental insurance with 100% employer More ❯

core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly and intuitive platform … action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Databricks Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team that values innovation and creativity, using your skills to … create customised solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! Reporting to the Manager, Field Engineering. The impact you will have: Form successful relationships with clients throughout your assigned territory, providing technical and business value to Databricks More ❯

Evaro is looking to do for health care what online banking has done for finance, and we're looking for a Head of Data Science to help us that through data-driven insights and innovations. Our mission? To increase accessibility to prescription medications and improve health outcomes by providing a seamless, technology-driven solution that empowers brands to … integrate digital health services effortlessly, Evaro strives to build the online banking for UK healthcare. About the job We're looking to hire a Head of Data Science to build out and lead the data science capabilities across the organisation. You'll have a background in analytics, machine learning, and leading data teams. You'll be joining … the company at an exciting time, working to build out a data team to help drive the company's direction. Ensuring that data isn't just analyzed but transformed into actionable insights that directly improve patient outcomes. Join Evaro as Head of Data Science to harness the power of healthcare data and help us create a More ❯

core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly and intuitive platform … action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Databricks Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team that values innovation and creativity, using your skills to … create customised solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! Reporting to the Manager, Field Engineering. The impact you will have: Form successful relationships with clients throughout your assigned territory, providing technical and business value to Databricks More ❯

Data Engineering Intern (Remote – 3 Month Internship) Company: HIRIST – IT Recruitment Partner (Hiring for a Technology Client) Location: Remote Job Type: Internship About the Role: HIRIST is hiring Data Engineering Interns on behalf of a reputed IT client. This remote, part-time internship is ideal for individuals aiming to develop hands-on experience in managing and building data pipelines. Interns will work closely with the engineering and data teams to support the development of scalable data infrastructure and improve data reliability and accessibility. Key Responsibilities: Assist in building and maintaining efficient, scalable data pipelines. Help with data ingestion, transformation, and integration processes. Support ETL (Extract, Transform, Load) tasks using modern data tools. Work with large datasets to optimize performance and quality. Collaborate with data scientists and analysts to ensure data availability. Required Qualifications: Familiarity with SQL and relational databases. Basic understanding of data structures and data modeling. Good problem-solving and logical thinking skills. Ability to work independently in a remote environment. Preferred Qualifications: Exposure to More ❯

core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly and intuitive platform … action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Databricks Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team that values innovation and creativity, using your skills to … create customised solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! Reporting to the Manager, Field Engineering. The impact you will have: Form successful relationships with clients throughout your assigned territory, providing technical and business value to Databricks More ❯

Social network you want to login/join with: Job Description We are seeking an experienced and visionary Head of Data Engineering to lead our dynamic Data Engineering Team. The successful candidate will oversee a team of approximately 40 Data Engineers, ensuring the delivery of high-quality data solutions and driving the strategic direction of our … Data Engineering efforts. Key Responsibilities: Lead and manage a team of 40 Data Engineers, providing mentorship, guidance, and career development. Develop and implement data engineering strategies that align with the companys goals and objectives. Oversee the design, development, and maintenance of scalable data pipelines and architectures. Collaborate with cross-functional teams, including data scientists, analysts … and IT, to ensure seamless data integration and utilization. Ensure data quality, integrity, and security across all data engineering projects. Lead presales activities, including client presentations, proposal development, and solution demonstrations. Stay up-to-date with the latest industry trends and technologies to drive innovation within the team. Manage project timelines, budgets, and resources effectively. Foster a More ❯

About Archive360Archive360 delivers a modern archiving platform that empowers organizations to address complex data governance and compliance challenges while leveraging AI and analytics. By transforming data into a trusted, accurate, and protected strategic asset, we help organizations achieve their business objectives and drive innovation. Position Overview:We are seeking a Pre-Sales Solutions Architect who blends technical expertise … our sales organization, bridging the gap between technical functionality and customer needs. You’ll partner closely with Sales, Product, and Engineering teams to deliver tailored solutions that solve complex data analysisand archiving challenges. Key Responsibilities: Be an expert in big data analytics to excite customers about Archive360. You will become a trusted advisor on multiple issues of … customer needs and business goals. Develop customer relationships and build internal partnerships with account executives and teams. What You Bring: Must have experience with ETL tools such as Azure Data Factory and processes for data extraction, transformation, and loading Must have experience with structured data management and migrations. Must have prior experience with involvement in application retirement More ❯

Software Architect (AWS) Shape the Future of Cloud Architecture at Verisk A Global Leader in Next-Gen Insurance Technology At Verisk, we empower businesses around the world with advanced data analytics and cloud-native solutions. As pioneers in technology and innovation, we help our clients make faster, smarter decisions using the most powerful tools in data science, AI … Software Architect (AWS) Shape the Future of Cloud Architecture at Verisk A Global Leader in Next-Gen Insurance Technology At Verisk, we empower businesses around the world with advanced data analytics and cloud-native solutions. As pioneers in technology and innovation, we help our clients make faster, smarter decisions using the most powerful tools in data science, AI … development to join our high-performing team. If youre a hands-on cloud expert who thrives on designing robust, scalable AWS architecturesand you bring deep understanding of API and data-driven solutionswe want to hear from you. Responsibilities What Youll Be Doing As a Principal Software Architect, youll be at the forefront of shaping and delivering scalable, secure, and More ❯

Data & Analytics Consultant HD-Tech is proud to be partnering with a leading data management and analytics consultancy that specialises in delivering transformative business insights using Microsoft technologies. With over 10 years of industry presence, our client is recognised for helping organisations optimise their use of data to drive smarter decisions and long-term value. As they … continue to scale their professional and managed services offerings, we re now seeking a Data & Analytics Consultant to join their expanding consulting team. About the Company This organisation is deeply committed to helping businesses "predict their future" through better use of data, technology, people, and process . Their services include: Managed Data Services Database and Infrastructure Consultancy … Data Engineering & Analytics Adoption and Change Management Their reputation is built on strong consulting skills, deep expertise in Microsoft Data Services, and a highly collaborative culture. They place a premium on client engagement, commercial awareness, and internal collaboration to drive results. Role Overview As a Consultant, you will play a hands-on role in delivering client-facing analytics More ❯

Data & Analytics Consultant HD-Tech is proud to be partnering with a leading data management and analytics consultancy that specialises in delivering transformative business insights using Microsoft technologies. With over 10 years of industry presence, our client is recognised for helping organisations optimise their use of data to drive smarter decisions and long-term value. As they … continue to scale their professional and managed services offerings, we’re now seeking a Data & Analytics Consultant to join their expanding consulting team. About the Company This organisation is deeply committed to helping businesses "predict their future" through better use of data, technology, people, and process . Their services include: Managed Data Services Database and Infrastructure Consultancy … Data Engineering & Analytics Adoption and Change Management Their reputation is built on strong consulting skills, deep expertise in Microsoft Data Services, and a highly collaborative culture. They place a premium on client engagement, commercial awareness, and internal collaboration to drive results. Role Overview As a Consultant, you will play a hands-on role in delivering client-facing analytics More ❯

Data Engineer (Databricks) - Leeds (Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. … They are looking for Data Engineers with significant Databricks experience to join an exceptional Agile engineering team. We are seeking a Data Engineer with strong Python, PySpark and SQL experience, possess a clear understanding of databricks, as well as a passion for Data Science (R, Machine Learning and AI). Database experience with SQL and No-SQL … exposure along with SOLID principles. Continuous Integration tools, Infrastructure as code and strong Cloud Platform knowledge, ideally with AWS is also key. We are keen to hear from talented Data Engineer candidates from all backgrounds. This is a truly amazing opportunity to work for a prestigious brand that will do wonders for your career. They invest heavily in training More ❯

Data Solution Architect ££125,000 GBP + benefits package Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solution Architect Location: London (Hybrid) Salary: Up to £125,000 + benefits package Contract Type: Permanent We are supporting a leading consulting client in their search for a Data Solution Architect to join a remote-first … data architecture team. This is a senior, delivery-focused role requiring deep technical expertise and end-to-end consulting experience across cloud-based data solutions. Key Responsibilities: Lead cross-functional teams to deliver scalable data solutions across cloud platforms Architect data lakes, lakehouses, and event-driven systems using tools like Databricks, Kafka, and Confluent Apply Data Mesh and Data Fabric principles to modern data architectures Define and implement data product strategies with a product-led mindset Ensure compliance with data governance and security standards (e.g. GDPR, HIPAA) Engage stakeholders and oversee technical delivery across Agile projects Skills & Experience: Proven experience as a Lead Data Solution Architect in consulting environments Expertise More ❯

of people, packages, and vehicles everywhere. More than 4 million registered developers have chosen Mapbox because of the platform's flexibility, security and privacy compliance. Organizations use Mapbox applications, data, SDKs and APIs to create customized and immersive experiences that delight their customers. Mapbox is the leading real-time location platform for a new generation of location-aware businesses. … of people, packages, and vehicles everywhere. More than 3.9 million registered developers have chosen Mapbox because of the platform's flexibility, security, and privacy compliance. Organizations use Mapbox applications, data, SDKs, and APIs to create customized and immersive experiences that delight their customers. What We Do The Telemetry team collects location telemetry from mobile Mapbox SDKs and uses it … customers of our unique, privacy-centric datasets on traffic patterns and human activity range from major corporations to local governments and NGO; but we are also committed to making data accessible to smaller developers, and work on a number of community-driven and open-source projects. We're a diverse team of backend engineers, data engineers, and data More ❯

SME/Data Analyst, 10-month contract, up to £550 p/d, Belfast (3 days in office) We are working with a global financial instituition to recruit for a data analyst in theMarkets Program Execution & Transformation - Data Acquisition Team, a strategic unit within Global Markets that collaborates with Legal, Compliance, Finance, and Operations & Technology to deliver … regulatory and cross-business transformation initiatives. This role focuses on designing and implementing integrated data solutions that support regulatory rulemaking, supervisory requirements, and strategic change projects. You'll work across multiple workstreams, delivering high-impact data solutions that drive efficiency and compliance for Markets and its clients. Key Responsibilities Build and optimize PySpark and SQL queries to analyze … reconcile, and interrogate large datasets. Recommend improvements to reporting processes, data quality, and query performance. Contribute to the architecture and design of Hadoop environments. Translate architecture and requirements into scalable, production-ready code. Provide technical leadership and direction on complex, high-impact projects. Act as a subject matter expert (SME) to senior stakeholders and team members. Develop project documentation More ❯

Head of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … direction, and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like Terraform More ❯

Head of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … direction, and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like Terraform More ❯

Job Title: Data Pipeline Developer About Us: We find strength in teamwork-a better you is a better us BLN24 is an award-winning Management Consulting Firm that supports the U.S. Federal Government in successfully achieving their mission and goals. Our service and solutions delivery start with understanding each client's end-state, and then seamlessly integrating within each … Agency's organization to improve and enhance strategic and technical operations and deployments. Job Description: BLN24 is seeking a skilled Data Pipeline Developer with demonstrated experience in transforming and loading data into Databricks. The ideal candidate will have successfully completed at least two projects of similar size and scope. Key Responsibilities: Develop and maintain data pipelines to … transform and load data into Databricks. Collaborate with data engineers, analysts, and other stakeholders to understand data requirements and ensure seamless data integration. Optimize data pipelines for performance, scalability, and reliability. Monitor and troubleshoot data pipeline issues to ensure data integrity and availability. Implement best practices for data pipeline development and maintenance. More ❯

Are you ready to take your data engineering skills to the next level? We are looking for a talented Data Engineer to join our innovative team and work closely with our Data Lead to implement a cutting-edge Business Intelligence (BI) platform. This is your chance to make a significant impact on our company's reporting and … analytics capabilities! About the Role As a Data Engineer, you will play a crucial role in transforming our organisation into a data-driven enterprise. Your primary responsibilities will include data ingestion from diverse source systems, development of data pipelines through both ETL tools and programming languages such as Python. You'll ensure that this data is structured, optimised, and accessible for our Power BI developers and business analysts, empowering them to turn data into actionable insights. Key Responsibilities Develop and optimise ETL processes to ensure data is readily available and useful. Create dynamic scripts for the ingestion of data with clear documentation. Collaborate with Power BI developers and business analysts to More ❯