776 to 800 of 1,108 Data Engineering Jobs

well-being. This includes 100% employer- paid medical insurance, ample paid leave, a free employee assistance program, and a competitive 401k savings plan. At Watermark, our people come first! Data Analyst In this role you will Execute Data Pipeline and Ontology Development and shall have experience working in dynamic environments with stakeholders from multiple external organizations. Experience Requirements … Shall have at least 1 year working with data engineering in the Palantir Foundry data integration platform or approved equivalent, inclusive of both data pipelines and complex ontology development. Have demonstrable extensive knowledge of distributed computing frameworks (e.g., Spark) and Foundry programming languages (Python, PySpark, SQL, TypeScript). Strong background in data analysis, data modeling, or a similar domain. Expertise in evaluating data elements, object names, and their attributes, with a keen eye for detail and accuracy. Education Requirements: Bachelor's degree in Data Science, Computer Science, Information Systems, or a related field. Certification Requirements: Must achieve Foundry Data Engineer certification within 90 days of hiring Security Clearance Requirements: TS More ❯

to make an outsized impact, you'll thrive here at Zopa, so join us, and make it count.Want to see us in action? Follow us on The team: The Data Engineering team own the pipelines that provide the business with the data it relies on. We're responsible for hundreds of different processes that work with data from Zopa's own services, our partners, and third party data providers. We tackle complex problems and have to build solutions that are reliable and scalable, while remaining cost effective. We work with all of Zopa's product teams and our work is crucial to delivering a great experience for our customers and developing attractive new product offerings. … review process Engineers often pair on work or just provide support to the rest of the team Other technical teams come to us for advice on integrating with our data platform, and we support product development by making sure high-quality analytics are alwaysavailable We always make time for learning and development and people tend to have a Udemy More ❯

team. What you will bring to the role: Develop and maintain Python scripts and applications using Databricks and PySpark Collaborate with cross-functional teams to design and implement effective data solutions Participate in code reviews to ensure adherence to best practices Write clean, maintainable Python code that adheres to SOLID principles and facilitates the robust development of our data infrastructure Troubleshoot and resolve technical issues promptly Stay ahead of the latest trends and advancements in Python development and data engineering Implement and maintain CI/CD pipelines for automated testing and deployment Design RESTful APIs that serve as the conduits for data flow across different systems within our enterprise Advance our AI/ML platform … by contributing to the data architecture that supports complex analytical models. Our values: We're all about people: Empowering them, supporting them, and helping protect what matters most to them We put people first, and stay true to our word, because we believe in the power of relationships and doing what's right We win together: We work as More ❯

Principal Data Engineer – AWS Location: London (Hybrid/Flexible) - Other UK Locations available Salary: £95,000 - £105,000 + Bonus A leading consultancy is hiring for a Principal Data Engineer to join their fast-growing data team, delivering cloud-native data platforms for high-profile clients across sectors. This role will focus on designing and implementing … end-to-end data solutions using modern AWS tooling. It suits someone who thrives in greenfield environments, enjoys client engagement, and values clean, scalable, well-documented engineering. Key Responsibilities: Design and build robust data pipelines using AWS (S3, Redshift, Glue, Lambda, Step Functions, DynamoDB). Deliver ETL/ELT solutions with Matillion and related tooling. Work closely with … junior engineers. Requirements: Strong hands-on AWS experience – S3, Redshift, Glue essential. Proven experience building ETL/ELT pipelines in cloud environments. Proficient in working with structured/unstructured data (JSON, XML, CSV, Parquet). Skilled in working with relational databases and data lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau, Looker, etc. More ❯

Principal Data Engineer – AWS Location: London (Hybrid/Flexible) - Other UK Locations available Salary: £95,000 - £105,000 + Bonus A leading consultancy is hiring for a Principal Data Engineer to join their fast-growing data team, delivering cloud-native data platforms for high-profile clients across sectors. This role will focus on designing and implementing … end-to-end data solutions using modern AWS tooling. It suits someone who thrives in greenfield environments, enjoys client engagement, and values clean, scalable, well-documented engineering. Key Responsibilities: Design and build robust data pipelines using AWS (S3, Redshift, Glue, Lambda, Step Functions, DynamoDB). Deliver ETL/ELT solutions with Matillion and related tooling. Work closely with … junior engineers. Requirements: Strong hands-on AWS experience – S3, Redshift, Glue essential. Proven experience building ETL/ELT pipelines in cloud environments. Proficient in working with structured/unstructured data (JSON, XML, CSV, Parquet). Skilled in working with relational databases and data lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau, Looker, etc. More ❯

the off. Role Overview: As a Senior Developer you will act as a rounded technologist to lead development on a range of different projects to greatly overhaul the organisations Data & AI functions. You will utilise data engineering skills for end-to-end development on a Microsoft tech stack. You will also work towards an exciting greenfield AI … project to dramatically increase the efficiency and automation processes within the organisation. Requirements: Data Engineering Skills AI Experience Python Expertise Azure/Microsoft Tech Stack (Preffered) Interviews ongoing don't miss your chance to secure the future of your career! Contact me @ or on . AI (artificial intelligence),Azure Data Factory, Python, Oracle, SQL, Mongo, Financial Services More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

We are looking for a Platform Technical Lead to drive a team to develop and deliver a Geospatial-Intelligence data engineering solution essential to National Security. Overview: NS2 Mission is seeking an experienced Platform Technical Lead to support a high-impact, data-driven program focused on geospatial intelligence and advanced data engineering solutions. This role … requires a highly skilled professional with a strong background in data engineering platforms and geospatial data management. You will lead a team of engineers and analysts in building scalable, mission-critical solutions that support national security objectives. Key Responsibilities: Provide overall leadership and strategic direction for the successful execution of all activities for an enterprise data management program, including long-term planning, prioritization, integration, and performance management. Serve as the primary technical authority overseeing the design, development, and integration of data pipelines, analytics tools, and geospatial systems. Lead and mentor a team of data engineers, developers, and geospatial analysts in implementing best practices and ensuring technical excellence. Collaborate with stakeholders and product owners More ❯

the off. Role Overview: As a Senior Developer you will act as a rounded technologist to lead development on a range of different projects to greatly overhaul the organisations Data & AI functions. You will utilise data engineering skills for end-to-end development on a Microsoft tech stack. You will also work towards an exciting greenfield AI … project to dramatically increase the efficiency and automation processes within the organisation. Requirements: Data Engineering Skills AI Experience Python Expertise Azure/Microsoft Tech Stack (Preffered) Interviews ongoing don't miss your chance to secure the future of your career! Contact me @ (url removed) or on (phone number removed). AI (artificial intelligence),Azure Data Factory, Python More ❯

Technical Business Analyst, SC Cleared We are seeking a highly skilled Technical Business Analyst with over 8 years of experience to support the evolution of enterprise modern cloud data platform used for ingesting and processing large volumes of streaming and batch data sets to support analytical and AI use-case. As a key interface between the technical and … business stakeholders, you will be responsible for translating data engineering, architectural and analytical requirements into detailed, actionable user stories with clear audit tracking and version control. Key Responsibilities Collaborate with Data Architects, Engineering teams, Security, Product teams and business stakeholders to gather, analyse, and translate their needs into clear and technically sound requirements. Facilitate discussions and … work with stakeholders to mitigate issues. Champion agile practices, facilitating sprint planning and retrospectives where needed. Key Skills 8+ years of experience as a Technical Business Analyst in complex, data-centric environments. Proven ability to write technical user stories for data pipelines, ETL processes, and analytics platforms. Strong understanding of data platforms, data lifecycle, and processing More ❯

Software Engineer Location: Merrifield, VA Type: Full Time Complete Data Solutions (CDS) is a leading data engineering and analytics company focused on providing our federal government clients with innovative solutions to complex data engineering and analytics problems. CDS is proud of the data engineering support we have provided to the Law Enforcement and … Intelligence Communities over our 25-year history. CDS provides data center, analytic, system design/development and reporting support to our federal clients. CDS offers competitive salaries and a comprehensive benefits program including health insurance, 401k, competitive paid annual leave, tuition reimbursement and host of other benefits, which reflects our long- term commitment to our staff. Job Description: CDS … is seeking a dedicated Java Developer with ETL experience handling multiple data formats to support our Government Client in developing and maintaining high-performance applications. The ideal candidate will have solid experience in Java development, a background in working with relational databases, hands-on experience with ETL (Extract, Transform, Load) processes and the ability to work with data More ❯

a unique opportunity to build and manage a complete AI team, vision, infrastructure, and suite of capabilities from the ground up. This role demands a deep understanding of hardware, data engineering, software engineering, containerization, and system administration, coupled with a proactive and problem-solving mindset. Seize your opportunity to fulfill our AI systems engineering requirements across … language models and other AI models. Optimize these engines for performance and efficiency. Evaluate and select open-weight models based on accuracy, performance, consistency, and unbiased responses. Implement prompt engineering concepts to provide optimal output and the best user experience. Develop Extract, Transform, Load (ETL) pipelines of structured and unstructured data from a verity of disparate sources. Properly … format, chunk, and embed documents into vector databases for advanced search and Retrieval Augmented Generation (RAG) capabilities. Implement and manage appropriate database solutions for storing and retrieving data relevant to the AI applications. Ensure data integrity, security, and performance. Maintain and troubleshoot the underlying Linux operating systems powering the AI infrastructure. Ensure system stability, security, and performance. Configure More ❯

We're looking for a Full Stack Engineer to join our team designing, developing and maintaining our applications which support data focused consultancy projects. The tools we create are used by technical consultants (Applied Data Scientists) to facilitate efficient delivery of insights and visualisations as part of client deliverables. The team is a multi-disciplinary data team … with a data analyst, a data scientist and another engineer. Engineers on the team work on a stack consisting of Python, AWS services, Snowflake, React, JavaScript, Terraform and Looker, amongst other tools when needed. Knowledge of our exact stack is desirable but not essential. This role will be based in Belfast with a flexible one day per week … work from office policy. What You Will Do: Develop and maintain internal tools: Build full stack applications that enable and streamline the delivery of insights and visualisations by Applied Data Scientists, using technologies like Python, React and AWS. Collaborate with technical consultants: Work closely with consultants to understand project needs and translate them into scalable, user-friendly tools and More ❯

Build the future of the AI Data Cloud. Join the Snowflake team. We are looking for a Commercial Solutions Engineer for the UK market who can solve our customer's most complex problems. In this role you will work directly with the account sales team and channel partners to understand the needs of our customers, strategize on how to … best support them in their evaluation and ultimately help our customers choose Snowflake as their solution. As a Snowflake Commercial Solutions Engineer you share our passion for solving complex data challenges and helping organizations to get the most out of their data assets. Our technical landscape is ever evolving and you are keen to learn new skills and … position Snowflake in relation to them Work closely with other sales engineers to make each other the best and constantly learn from wins and losses Collaborate with Product Management, Engineering, and Marketing to continuously improve Snowflake's products and marketing Represent Snowflake at industry or customer events Work with our ecosystem and implementation partners to build joint architectures or More ❯

Media, Digital business transformation with Publicis.Sapient, and Health & Wellbeing with Publicis Health. Freelance Adobe Analytics Director EMEA We are looking for a Analytics Director EMEA to identify all active data sources in the quarter, work with Data Engineering team to ensure data pipelines are setup, feed is populating data, refreshed periodically to ensure data availability for weekly processing. Key Requirements: •Minimum 7 years of experience of paid digital reporting within a media agency or client-side dealing with large volumes of data •Understanding of media industry, agency background, marketing •Experienced in tools and methodologies (ETL, Data Management, Agile, Kanban, Data visualisation principles) •Experience of using PowerBI to build dashboards and … a clear understanding of the development project life cycle, from gathering requirements to the roll out to end users •Knowledge of relevant Data visualisation applications, JavaScript or Python, data structuring and manipulation •Experience with delivering complex technical content to large groups, in a coherent, accessible and inspiring way Please send your CV, availability and day rate to chanelle.hall More ❯

Media, Digital business transformation with Publicis.Sapient, and Health & Wellbeing with Publicis Health. Freelance Adobe Analytics Director EMEA We are looking for a Analytics Director EMEA to identify all active data sources in the quarter, work with Data Engineering team to ensure data pipelines are setup, feed is populating data, refreshed periodically to ensure data availability for weekly processing. Key Requirements: •Minimum 7 years of experience of paid digital reporting within a media agency or client-side dealing with large volumes of data •Understanding of media industry, agency background, marketing •Experienced in tools and methodologies (ETL, Data Management, Agile, Kanban, Data visualisation principles) •Experience of using PowerBI to build dashboards and … a clear understanding of the development project life cycle, from gathering requirements to the roll out to end users •Knowledge of relevant Data visualisation applications, JavaScript or Python, data structuring and manipulation •Experience with delivering complex technical content to large groups, in a coherent, accessible and inspiring way Please send your CV, availability and day rate to chanelle.hall More ❯

Build the future of the AI Data Cloud. Join the Snowflake team. We are looking for a Commercial Sales Engineer for the market who can solve our customer's most complex problems. In this role you will work directly with the account sales team and channel partners to understand the needs of our customers, strategize on how to best … support them in their evaluation and ultimately help our customers choose Snowflake as their solution. As a Snowflake Commercial Solution Engineer you share our passion for solving complex data challenges and helping organizations to get the most out of their data assets. Our technical landscape is ever evolving and you are keen to learn new skills and put … position Snowflake in relation to them Work closely with other sales engineers to make each other the best and constantly learn from wins and losses Collaborate with Product Management, Engineering, and Marketing to continuously improve Snowflake's products and marketing Represent Snowflake at industry or customer events Work with our ecosystem and implementation partners to build joint architectures or More ❯

Are you a proven leader with a passion for data-driven missions in the Intelligence Community? We are seeking a dynamic Program Manager to oversee a mission-critical ETL/Data program supporting enterprise-level data integration and transformation. This role offers the opportunity to directly support national security objectives while leading talented teams through complex data … direction for the successful execution of all activities outlined in the PWS, including long-term planning, prioritization, integration, and performance management. Oversee cross-functional teams of engineers, analysts, and data professionals to deliver enterprise-level ETL pipelines, data integration, and transformation solutions. Interface regularly with government stakeholders to ensure program alignment with mission needs and drive schedule adherence … risk management, resource allocation, and budget compliance. Prepare and deliver program reports, technical briefings, and presentations while monitoring KPIs and data quality benchmarks to maintain operational excellence. Identify and implement process improvements, automation opportunities, and ensure compliance with all applicable security, accreditation, and clearance requirements. Position Requirements: Active TS/SCI clearance (required) Bachelor's or Master's degree More ❯

Mandatory) Demonstrated experience with Java, JavaScript, Python or similar development languages and associated frameworks for applications development such as Flask, ReactJS or similar. 3. (Mandatory) Demonstrated experience working with data in, and developing applications with, Sql and NoSQL databases. 4. (Mandatory) Demonstrated experience documenting system design and architecture. 5. (Mandatory) Demonstrated strong coordination and collaboration skills with ability to … Sponsor's environment. 9. (Desired) Demonstrated experience working in an Agile software development cycle. 10. (Desired) Demonstrated experience with Sql and NoSQL databases. 11. (Desired) Demonstrated experience with geospatial data, visualization, and relevant analytic methods and tools. 12. (Desired) Demonstrated experience manipulating large datasets. 13. (Desired) Demonstrated experience with open source data engineering tools and processes. More ❯

engineering. • Implement Retrieval-Augmented Generation (RAG) for effective querying of Confluence/Jira documents. • Design and implement multi-agent coordination patterns, such as planner-executor and supervisor-worker. Software Engineering Tool Integration: • Integrate with Jira REST API/GraphQL, Bitbucket Cloud REST API, or Git command-line for seamless workflow automation. • Integrate with Atlassian to react to new events … in Jira/Bitbucket. • Integrate MS Teams for chat-based agent interactions. Data Engineering & Analysis: • Parse logs and summarize natural language content (e.g., commit messages, PRs, tickets). • Analyze time series and event data to detect bottlenecks and patterns. • Apply embedding techniques to represent documentation, issues, or discussions. Cloud & Infrastructure: • Utilize containerization (Docker) for deploying agents. • Ensure … least 2 reference projects in Gen AI, preferable one on Agentic AI • Proficient in integrating APIs and developing function calling/tool use orchestration. • Experience with vector databases, prompt engineering, and Retrieval-Augmented Generation (RAG). • Strong background in software engineering tool integration and data engineering/analysis. • Experience with CI/CD pipelines and cloud More ❯

As an Architect/Staff Software Engineer at Contiamo, you are a technical leader who shapes the direction and quality of our engineering work across multiple projects and clients. This role brings a systems-level perspective that enables architecting solutions spanning multiple projects or clients from POC to Production. Activities Design Solutions: Take ownership of high-level systems designs … with a proactive approach to learning, improvement, and solving complex problems that can be shared across technical and non-technical audiences. Experience working across the entire application development and data engineering spectrum: micro apps, distributed systems and streaming data, and data warehousing. Demonstrated commitment to quality, with the ability to balance speed and reliability. Strong proficiency … in Python (or a similar language like Go, NodeJS) with extensive experience building, debugging, and optimizing APIs, distributed systems, and/or data pipelines. Experience with modern technologies and frameworks including FastAPI, PydanticAI, Haystack AI, OpenTelemetry, Procrastinate, databases like Postgres and Snowflake, queue systems such as SQS/Kafka, and Airflow. Hands-on experience with Kubernetes, including orchestration and More ❯

Morgan Hunt are working with a large public sector organisation to recruit a PowerBI developer on a 3 month contract. The role sits within the analytics team within the data and AI function and plays an important role in transforming data into structures that enable analysis and decision making. Extensive experience designing and building complex dashboards and data models for reporting is essential. Key responsibilities: Work with business users to develop scalable and maintainable Power BI Dashboards adhering to security access rules Design, build and test data models in both Azure Synapse and Power BI, ensuring they can be used for effective analysis and decision-making. Partner with subject matter experts to understand the logic and … relationships between data objects and build physical data models and semantic layers which reflect those needs. Provide support to colleagues and users, investigate issues and present findings to technical and non-technical stakeholders Collaborate with the Data Engineering and Operations team to triage, troubleshoot and resolve support issues with products 3 month contract (possible extension) Hybrid More ❯

As a 2nd BN CSD Information Assurance Analyst, you will need experience in the following: Responsibilities: Employs mathematics, statics, information science, artificial intelligence, machine learning, network science, probability modeling, data mining, data engineering, data warehousing, data compression, data protection, and/or other scientific techniques to correlate complex, technical findings into graphical, written, visual … and verbal narrative products on trends of existing intelligence data to leverage other IC data sources. Develops and utilizes machine learning and data mining algorithms, including, but not limited to, Multiple Information Model Synthesis Architecture (MIMOSA) prediction algorithms based on open source capabilities. Integrates or codes algorithms to support Government intelligence search and discovery missions. Makes best … practice recommendations on managing data within hardware, software, storage, and bandwidth constraints. Employs data science techniques to support predictive analysis, social media and crowd-source data analytics, wargaming, and strategy development Employs exploratory analysis and rapid iteration techniques of large volumes of data to quickly derive intelligence. Minimum Experience: Demonstrate comprehensive mission knowledge and skills that More ❯

Morgan Hunt are working with a large public sector organisation to recruit a PowerBI developer on a 3 month contract. The role sits within the analytics team within the data and AI function and plays an important role in transforming data into structures that enable analysis and decision making. Extensive experience designing and building complex dashboards and data models for reporting is essential.Key responsibilities: Work with business users to develop scalable and maintainable Power BI Dashboards adhering to security access rules Design, build and test data models in both Azure Synapse and Power BI, ensuring they can be used for effective analysis and decision-making. Partner with subject matter experts to understand the logic and relationships … between data objects and build physical data models and semantic layers which reflect those needs. Provide support to colleagues and users, investigate issues and present findings to technical and non-technical stakeholders Collaborate with the Data Engineering and Operations team to triage, troubleshoot and resolve support issues with products 3 month contract (possible extension)Hybrid working More ❯

environments, ensuring continuous improvement and rapid problem resolution in support of development, testing, deployment, and optimization of a large-scale cloud environment. Our team is developing a cloud native data mesh or data layer to support the implementation of an agency-wide enterprise data strategy, including data discovery, data sharing, and comprehensive data governance. … The system will include the ability for data owners to control their own data in the ecosystem within producer domains and publish data to internal or external data users through consumer domains. The testing component of this role is expected to grow over time as additional functions or features of the Enterprise data layer or … data mesh are developed, including integration of data governance through Collibra, implementation of user interfaces such as producer or consumer domains, and development and deployment of data query and data visualization functions. Functionality, reliability, and user experience are key to successful sof tware development, and that means rigorous testing. You will work within a collaborative Agile More ❯