1 to 25 of 654 Big Data Jobs

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion pipelines More ❯

About Exsolvæ: Exsolvæ is a Brussels-based consultancy at the forefront of Data and Artificial Intelligence innovation. We specialize in providing expert Consultancy, Audit, and Solution Development services to empower our partners in overcoming unique challenges. Our holistic approach fosters collaboration across diverse domains, including Data Engineering, Advanced Analytics, and AI. At Exsolvæ, our "Solvers" are passionate professionals … equipped with cutting-edge tools, a culture of continuous learning, and an unwavering commitment to delivering high-impact solutions. We are seeking a Data Engineering Specialist with expertise in Azure technologies to join our expert team. Your Role: As a Data Engineering Specialist with a focus on Azure, you will design and implement cloud-native data solutions … that enable clients to unlock the full potential of their data assets. You will collaborate with multidisciplinary teams, utilizing advanced Azure technologies to build scalable, efficient data pipelines, data models, and analytics workflows. What We're Looking For: Required Skills and Qualifications Educational Background : Bachelor's or Master's degree in Computer Science, Data Engineering, or More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities IBM is seeking a skilled Senior Data Engineer to join our dynamic team, focusing on public sector accounts. This role offers an exciting opportunity to leverage your expertise in data engineering to drive impactful solutions … for government clients. The Senior Data Engineer will be responsible for designing, developing, and managing scalable data pipelines, integrating heterogeneous systems, and implementing robust data models. The ideal candidate will collaborate with cross-functional teams to ensure data integrity, security, and availability, while meeting regulatory requirements specific to the public sector. Required education None Preferred education … Bachelor's Degree Required technical and professional expertise Responsibilities: Design, build, and maintain scalable data pipelines and ETL processes. Collaborate with data scientists and engineers to integrate complex data systems. Ensure data quality, accuracy, and reliability through testing and validation procedures. Develop and implement data storage solutions, including data modeling and schema design. Provide More ❯

Curve is a next-gen insights, analytics and technology consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Digital consumer data is powerful; it's big, it's real, and it's always updating. We use a combination of in-house technology and bespoke solutions, powered by AI, to transform data … machine learning and AI are key to how we deliver impact, centred on: Natural Language Processing, GPT & other LLMs : unearthing trends, themes and other patterns from large text-based data sets, and deploying state-of-the-art AI to automate and empower consumer facing businesses and their insights & analytics functions Marketing Data Science & Personalisation : using first party consumer … data to understand each client's consumer base, building personalisation and other machine learning models to better engage with and excite consumers Data Engineering & Data Architecture : data engineering across a variety of tools to integrate these leading technologies into optimised and efficient data models and ecosystems, feeding into best-in-class analytics dashboards, marketing activation More ❯

Data Scientist Department: Research & Analytics Location: Washington, DC - Fully On-site Required Role Type: 6-month Contract Position About Our Client Our client is a well-established technology solutions provider that has been serving critical government missions for decades. They specialize in delivering advanced data analytics, cybersecurity, and engineering solutions that support national security and public safety initiatives. … Their core mission focuses on innovation and excellence in supporting government operations, with strong values centered on integrity and collaborative problem-solving. Job Description Our client is seeking a Data Scientist to support a large U.S. Department of Justice (DOJ) program within the Antitrust Division. In this role, you will apply your expertise in data analytics, machine learning … and computational methods to extract meaningful insights from large, complex datasets. Your day-to-day work will involve leading data-driven research and developing sophisticated analytical solutions that support the enforcement of federal antitrust laws and promotion of fair competition in the marketplace. This position offers the opportunity to make a direct impact on important research efforts in areas More ❯

Develop a deep understanding of Visa's data assets and how they can be used to support Data Science activities across the company Execute data engineering projects ranging from small to large either individually or as part of a project team. Build and maintain ETL pipelines in Spark, Python or HIVE that process transaction and account level … data and standardize data fields across various data sources Troubleshoot Design, develop, and maintain reusable data assets Define and build technical/data documentation and experience with code version control systems (e.g. git). Ensure data accuracy, integrity and consistency Collaborate with Data Engineering teams in North America and other Global regions to … production and maintenance of key data assets. This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager. Required qualifications: Bachelor's Degree in an analytical field such as computer science, statistics, finance, economics or relevant area. Entry level experience of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, MLlib, GraphX, iPython More ❯

technology and a desire to make a real impact in the financial services industry, we would love to hear from you. About this role We are seeking a skilled Data Engineer - Data Lakehouse to join our team. The ideal candidate should be experienced in designing and building data pipelines, performing ETL operations, and managing databases. The candidate … will also need to have knowledge and experience in using AWS services for data processing, storage, and analysis. Responsibilities Design, build and maintain efficient and scalable data pipelines to support data processing and analysis. Develop and implement ETL processes to ensure data quality and integrity. Manage and optimize databases, including designing schema and indexing strategies, data partitioning and data archival. Work closely with data scientists and business analysts to understand data requirements and translate them into technical solutions. Collaborate with DevOps and IT teams to deploy, monitor and troubleshoot data systems. Develop and maintain documentation on data infrastructure and processes. Stay current with the latest data engineering technologies, tools More ❯

manufacturing facilities and employees in multiple countries committed to serving patients worldwide. Please visit www.jazzpharmaceuticals.com for more information. The Senior Principal will be responsible for leading projects related to data engineering requirements and initiatives across Jazz Research and Development. The Senior Principal will lead data projects from across the business including Clinical, Pre-Clinical, Non-Clinical, Chemistry, RWD … and Omics. Essential Functions Lead the design, development and maintenance of data pipelines for processing Research and Development data from diverse sources (Clinical Trials, Medical Devices, Pre-Clinical, Omics, Real World Data) utilizing the AWS technology platform. Create and optimize ETL/ELT processes for structured and unstructured data using Python, R, SQL, AWS services and … other tools. Build and maintain data repositories using AWS S3 and FSx technologies. Establish data warehousing solutions using Amazon Redshift. Build and maintain standard data models. Own data quality frameworks, validation processes and KPIs to ensure accuracy and consistency of data pipelines. Implement data versioning and lineage tracking to support data traceability, regulatory More ❯

manufacturing facilities and employees in multiple countries committed to serving patients worldwide. Please visit www.jazzpharmaceuticals.com for more information. The Senior Principal will be responsible for leading projects related to data engineering requirements and initiatives across Jazz Research and Development. The Senior Principal will lead data projects from across the business including Clinical, Pre-Clinical, Non-Clinical, Chemistry, RWD … and Omics. Essential Functions Lead the design, development and maintenance of data pipelines for processing Research and Development data from diverse sources (Clinical Trials, Medical Devices, Pre-Clinical, Omics, Real World Data) utilizing the AWS technology platform. Create and optimize ETL/ELT processes for structured and unstructured data using Python, R, SQL, AWS services and … other tools. Build and maintain data repositories using AWS S3 and FSx technologies. Establish data warehousing solutions using Amazon Redshift. Build and maintain standard data models. Own data quality frameworks, validation processes and KPIs to ensure accuracy and consistency of data pipelines. Implement data versioning and lineage tracking to support data traceability, regulatory More ❯

manufacturing facilities and employees in multiple countries committed to serving patients worldwide. Please visit www.jazzpharmaceuticals.com for more information. The Senior Principal will be responsible for leading projects related to data engineering requirements and initiatives across Jazz Research and Development. The Senior Principal will lead data projects from across the business including Clinical, Pre-Clinical, Non-Clinical, Chemistry, RWD … and Omics. Essential Functions Lead the design, development and maintenance of data pipelines for processing Research and Development data from diverse sources (Clinical Trials, Medical Devices, Pre-Clinical, Omics, Real World Data) utilizing the AWS technology platform. Create and optimize ETL/ELT processes for structured and unstructured data using Python, R, SQL, AWS services and … other tools. Build and maintain data repositories using AWS S3 and FSx technologies. Establish data warehousing solutions using Amazon Redshift. Build and maintain standard data models. Own data quality frameworks, validation processes and KPIs to ensure accuracy and consistency of data pipelines. Implement data versioning and lineage tracking to support data traceability, regulatory More ❯

time left to apply End Date: July 9, 2025 (13 hours left to apply) job requisition id R095916 We're the world's leading data, insights, and consulting company; we shape the brands of tomorrow by better understanding people everywhere. Kantar's Profiles division is home to the world's largest audience network. With access to 170m+ people in … over 100 global markets, we offer unrivalled global reach with local relevancy. Validated by industry leading anti-fraud technology, Kantar's Profiles Audience Network delivers the most meaningful data with consistency, accuracy, and accountability - all at speed and scale. We are looking for an experienced Lead Data Engineer to join our team in Reading/London! The key … production to provide protection, however, we believe that we need to stay ahead of the evolving fraud and invest in this area so we can always provide the best data and the best answers for our customers globally. We know that better decisions can be made when the right data and more timely and relevant information is available More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

maintaining robust and scalable machine learning pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based on personality, potential, and enthusiasm … development best practices and methodologies. Experience with version control systems (e.g., Git). Familiarity with CI/CD tools and practices. Strong problem-solving and analytical skills. Understanding of data structures and algorithms. Ability to design and develop scalable, efficient, and maintainable software systems. Experience with microservice architecture, API development. Machine Learning (ML): Deep understanding of machine learning principles … algorithms, and techniques. Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. Proficiency in data preprocessing, feature engineering, and model evaluation. Knowledge of ML model deployment and serving strategies, including containerization and microservices. Familiarity with ML lifecycle management, including versioning, tracking, and model monitoring. Ability to optimize and fine-tune ML models for More ❯

maintaining robust and scalable machine learning pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based on personality, potential, and enthusiasm … development best practices and methodologies. • Experience with version control systems (e.g., Git). • Familiarity with CI/CD tools and practices. • Strong problem-solving and analytical skills. • Understanding of data structures and algorithms. • Ability to design and develop scalable, efficient, and maintainable software systems. • Experience with microservice architecture, API development. Machine Learning (ML): • Deep understanding of machine learning principles … algorithms, and techniques. • Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. • Proficiency in data preprocessing, feature engineering, and model evaluation. • Knowledge of ML model deployment and serving strategies, including containerization and microservices. • Familiarity with ML lifecycle management, including versioning, tracking, and model monitoring. • Ability to optimize and fine-tune ML models for More ❯

We are looking for an experienced Cloud Data Architect to join our Data (Migration) team and drive the architecture, design, and implementation of customers modern data platforms. The ideal candidate will have extensive experience migrating traditional data warehouse technologies, including Teradata, Oracle, BW, Hadoop to modern cloud data platforms like Databricks, Snowflake, Redshift, Bigquery, or … Microsoft fabric. You will be responsible for leading data platform migrations and the design and development of scalable data solutions that support our organization's strategic goals. Data Architecture and Strategy: Lead the development and implementation of data architecture strategies that align with business objectives. Design and oversee the architecture of enterprise data warehouses, data lakes, and big data platforms. Establish best practices and standards for data modeling, integration, and management. Platform Design and Implementation: Architect, design, and implement data warehouse solutions using platforms like Databricks, Redshift, BigQuery, Synapse, and Snowflake. Develop scalable big data solutions using cloud data technologies and services. Ensure the data architecture More ❯

Company description: At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable … Place To Work. This prestigious award is based entirely on what current employees say about their experience working at Circana. Job description: We are seeking a skilled and motivated Data Engineer to join a growing global team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud … platform. You will leverage your expertise in PySpark, Apache Spark, and Apache Airflow to process and orchestrate large-scale data workloads, ensuring data quality, efficiency, and scalability. If you have a passion for data engineering and a desire to make a significant impact, we encourage you to apply! Job Responsibilities ETL/ELT Pipeline Development: Design, develop More ❯

to ESPN and ESPN+, and much more. Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news. The Data Reliability Engineering team for Disney's Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment's big data platform … which processes hundreds of terabytes of data and billions of events daily. Job Summary: The Senior Software Engineer will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven. You will work closely with our partner teams to monitor and drive improvements for reliability and observability of … their critical data pipelines and deliverables. This is a high-impact role where your work informs decisions affecting millions of consumers, with a direct tie to The Walt Disney Company's revenue. You will be making an outsized impact in an organization that values data as its top priority. We are a tight and driven team with big More ❯