26 to 50 of 672 Permanent Big Data Jobs

Big Data Subject Manager Expert (SME) Northern, VA area Full-Time On-site Position Contingent Upon Award Join Synertex LLC and bring your expertise to a mission that matters. We're looking for a Big Data Subject Matter Expert (SME) with a background in advanced analytics, machine learning, and multi-cloud architectures to support critical government … and intelligence initiatives. If you're passionate about solving complex data challenges at scale and thrive in a high-impact, technically rigorous, and innovation-driven role-this opportunity is for you. RESPONSIBILITIES Design and optimize big data frameworks for use across multi-cloud environments Apply machine learning models to support mission-focused data analysis and automation … Build scalable analytics solutions for structured and unstructured data sets Provide strategic input on data architecture, governance, and security Collaborate with engineering, analytics, and mission teams to translate requirements into solutions Assess new technologies and tools to enhance enterprise data capabilities Support integration of data sources across cloud-native and on-premises systems REQUIREMENTS TS/ More ❯

and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You An experienced Lead Data Architect & Engineer who is a positive, collaborative, proactive, self-driven professional with a passion for building scalable data solutions. Confident working across teams, and comfortable managing multiple stakeholders. … An innovative and systems-focused mindset, with a proven track record of designing infrastructure that supports both immediate business needs and long-term growth. An accomplished Lead Data Engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Strong expertise in designing … and maintaining scalable data pipelines and architectures—integrating data from web analytics, content management systems (CMS), subscription platforms, ad tech, and social media. Proven ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. Experience building robust data models and More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

We have 9 NEW open positions based in our London office. As a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and … and productionalizing customer use cases Work with engagement managers to scope a variety of professional services work with input from the customer Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications Consult on architecture and design … Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution for engagement specific product and support issues. What we look for: Proficient in data engineering, data platforms, and analytics with a strong track record of successful projects and in-depth knowledge of industry best practices Comfortable writing code in either Python or More ❯

We have 9 open positions based in our London office. As a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform. You will provide data engineering, data science, and cloud … s and productionalising customer use cases Work with engagement managers to scope a variety of professional services with input from the customer Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications Consult on architecture and design … Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution of engagement-specific product and support issues. What we look for: Proficient in data engineering, data platforms, and analytics with a strong track record of successful projects and in-depth knowledge of industry best practices Comfortable writing code in either Python or More ❯

Data Engineering Manager, Amazon Music Technology We are seeking an ambitious Data Engineering Manager to join our Metrics and Data Platform team. The Metrics and Data Platform team plays a critical role in enabling Amazon Music's business decisions and data-driven software development by collecting and providing behavioral and operational metrics to our internal … teams. We maintain a scalable and robust data platform to support Amazon Music's rapid growth, and collaborate closely with data producers and data consumers to accelerate innovation using data. As a Data Engineering Manager, you will manage a team of talented Data Engineers. Your team collects billions of events a day, manages petabyte-scale … datasets on Redshift and S3, and develops data pipelines with Spark, SQL, EMR, and Airflow. You will collaborate with product and technical stakeholders to solve challenging data modeling, data availability, data quality, and data governance problems. At Amazon Music, engineering managers are the primary drivers of their team's roadmap, priorities, and goals. You will More ❯

accordingly. This is an incredible opportunity to be part of this transformation journey. Responsibilities: The Solution Architect will be responsible for re-engineering the interaction of incoming and outgoing data flows from the Core Accounts DDA platform to Reference Data platforms, Data Warehouse, Data Lake as well as other local reporting systems which consume data from Core Accounts Drive the data architecture and roadmap for eliminating non-strategic point to point connections and batch handoffs Define canonical data models for key entities and events related to Customer, Account, Core DDA in line with the Data Standards Assess opportunities to simplify/rationalize/refactor the existing database schemas paving way for … modularization of the existing stack Provide technical guidance to Data Engineers responsible for designing an Operational Data Store for intra-day and end-of-day reporting. Implementing data strategies and developing logical and physical data models. Formulate efficient approach to rationalize and formulate strategy to migrate reports Build and nurture a strong engineering organization to deliver More ❯

Artificial Intelligence Engineer/Data Scientist £50k - £90k dependant on experience bonus good bens. Flexible Working Location opportunity. This role may suit individuals who have previously held roles such as Data Engineer, Data Architect, Big Data Consultant, Data Scientist, Data Modeller, Big Data Analyst, or AI Engineer. We are assisting in … recruiting AI Engineers/Data Scientists to join an innovative and growing team within the data practice of a prestigious global technology consulting firm. The client offers excellent career growth, professional development, and a personalized benefits package. Candidates must ideally have UK security clearance and be fully flexible regarding working location. The successful candidate will be a key … team member designing modern analytical data solutions, engaging in the full project lifecycle. The role offers a diverse range of exciting work. Key Skills We are recruiting at various levels within the salary range, so candidates are not expected to be experienced in all areas listed below. AI techniques (supervised and unsupervised machine learning, deep learning, graph data More ❯

of the competitive consulting companies, headquartered in United Kingdom that provide cutting-edge technology solutions, that enable businesses to thrive in the digital era. We specialize in Cloud, DevOps, Data Science, Blockchain, IoT, and Metaverse technologies, and our team of experts is dedicated to delivering innovative solutions that drive business growth and transformation. Our team of experts has years … mandatory that the candidate should have handled more than 2 projects in the above framework using Scala. Should have 4+ years of relevant experience in handling end to end Big Data technology. Meeting with the development team to assess the company's big data infrastructure. Designing and coding Hadoop applications to analyze data collections. Creating … data processing frameworks. Extracting data and isolating data clusters. Testing scripts and analyzing results. Troubleshooting application bugs. Maintaining the security of company data. Training staff on application use Good project management and communication skills. Designing, creating, and maintaining Scala-based applications Participating in all architectural development tasks related to the application. Writing code in accordance with the More ❯

We believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products … content and services millions of people love. And we do it all right here at Sky. The team is looking for a Data Architect to join the IoT platform team, supporting technical initiatives aimed at enhancing data architecture and improving the platform's data handling capabilities. This role will focus on designing scalable data models, ensuring … data quality, and streamlining the integration of data sources for real-time analytics and platform performance. The Data Architect will also play a key role in implementing data governance policies to ensure compliance, security, and proper management of IoT data. Additionally, the role will involve aligning IoT data practices with broader company data standards More ❯

Post Date 105251 Requisition Stanford Center for Genomics and Personalized Medicine (SCGPM) has an exciting opportunity available for a motivated Bioinformatics Systems Architect/Team Leader to create innovative data infrastructures that will automate the process of turning big genomic data into biomedical insights. The ideal person for this position is a keen listener who can interpret … actionable technical solutions. Background: The Department of Veterans Affairs (VA) has commissioned the sequencing of thousands of whole genomes from participants in the Million Veteran Program (MVP) . This data is currently being delivered to the SCGPM's cloud computing environment and constitutes one of the largest repositories of whole-genome sequencing data in the world. The scale … and richness of this data make it an incredible resource for biomedical research. Our goal is to turn this data lake into a data commons: a dynamic computing environment where researchers bring questions and get answers, all without having to go through the ordeal of manually collecting, cleaning, massaging, scrubbing, sorting, transforming, and filtering data. Position: In More ❯

View more categories View less categories Discipline Maths & IT ,Data Analysis Position Type Permanent Hours Full Time Result Type Jobs Job Description Summary -Understand complex and critical business problems, formulates integrated analytical approach to mine data sources, employ statistical methods and machine learning algorithms to contribute solving unmet medical needs, discover actionable insights and automate process for reducing … effort and time for repeated use. To manage the implementation and adherence to the overall data lifecycle of enterprise data from data acquisition or creation through enrichment, consumption, retention, and retirement, enabling the availability of useful, clean, and accurate data throughout its usefull lifecycle. High agility to be able to work across various business domains.High agility … give people with disease and their families a brighter future to look forward to. Apply today and welcome to where we thrive together! The Role As a Senior Principal Data Scientist in the Medical Affairs Advanced Quantitative Sciences group, you will be responsible for the discussion and implementation of data science methodologies applied to patient-level data More ❯

totaled $13.8 billion. Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof … implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data visualization and Data More ❯

totaled $13.8 billion. Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof … implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data visualization and Data More ❯

BT drives security decision making impacting all levels of the organization. As a large, distributed, multinational IT-based company, BT has a unique view of global cyber threat, including data sets that have never been available to the industry before. We are developing novel and sophisticated ways of analysing this data to ensure we stay ahead in this … exciting and challenging environment. As an experienced data engineer, you will be responsible for developing and maintaining data pipelines, so that this highly skilled team of data scientists, data engineers and developers, continue to generate unique, innovative and impactful intelligence. This role is hybrid (3 days in office) & can be based in either Bristol or Manchester … What you'll be doing Developing and maintaining Data Pipelines for extraction, transformation and loading processes Assembling large, complex data sets that meet user and business requirements Collaborating with data scientists and intelligence analysts, to support and deliver against their requirements Identifying and implementing process improvements to enhance data delivery and scalability Build and maintain collaboration More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯