151 to 175 of 763 Data Engineer Jobs

Amyx is seeking to hire a Sr Data Engineer to support our Army client at Ft. Belvoir, VA. The Sr Data Engineer will be required ensure design best practices are applied to the cPROBE data repositories and provide recommendations for improving performance, security, reliability and availability of the data within the system. Responsibilities The … Sr Data Engineer will be primary responsible for the environment's database layer support the Army G8 PA&E. They will coordinates administrative functions to ensure data is reliably available and access times are minimized allowing quickest access possible to data. They will be responsible for all interfaces into and out of the data layer and … for API hub allowing data exchanges with internal and external sources or systems. They will ensure applications can access data with minimum latency and Facilitate change control, problem management, and communication among data architects, programmers, analysts, and engineers. They will establish and enforce processes to ensure a consistent, well managed, and well-integrated data infrastructure. They More ❯

supporting 100% remote work anywhere within the United States. Must be able to support Eastern Time Zone ICF is a rapidly growing, entrepreneurial, multi-faceted consulting company, seeking a Data Engineer. The Data Engineer will help bring new data insights to a government agency committed to improving child welfare. The ICF team performs custom software development … oral presentations.Team members are also expected to uphold and maintain appropriate certifications necessary for their practice expertise. What you'll be doing: Help build, and optimize a AWS-based data lake to support AI/ML initiatives and advance analytics Design and implement scalable data ingestion pipelines for both batch and real-time data from diverse structured … and unstructured sources Perform extensive data profiling, transformation and enrichment to prepare clean, ML ready datasets for data scientists and analysts. Develop custom reports and data visualizations to support analytics, decision-making across business and technical teams Collaborate with data scientists and business teams to deliver curated datasets and reporting needs for ML and analytics. Support More ❯

Contract Data Engineer - APIs/Python/Power BI/Machine Learning £400 to £500 per day (Outside IR35) 6-month initial contract with likely extensions Hybrid, two days per week onsite with a Midlands-based retail business The opportunity A leading UK retail business is expanding its data function and looking for a hands-on Data Engineer to help improve how data moves, connects and delivers insight across the organisation. You will work in a small, collaborative team that focuses on building APIs, automating data processes and creating reliable reporting frameworks. The role blends engineering, analytics and applied AI, offering genuine variety and visible impact. What you will be doing Building and … optimising data pipelines and APIs between internal systems and third-party partners Improving data quality, automation and consistency across storage and reporting layers Designing and publishing Power BI reports and dashboards to support commercial decision making Exploring opportunities to apply AI and machine learning to improve forecasting and automation Working closely with stakeholders to align data solutions More ❯

Contract Data Engineer - APIs/Python/Power BI/Machine Learning £400 to £500 per day (Outside IR35) 6-month initial contract with likely extensions Hybrid, two days per week onsite with a Midlands-based retail business The opportunity A leading UK retail business is expanding its data function and looking for a hands-on Data Engineer to help improve how data moves, connects and delivers insight across the organisation. You will work in a small, collaborative team that focuses on building APIs, automating data processes and creating reliable reporting frameworks. The role blends engineering, analytics and applied AI, offering genuine variety and visible impact. What you will be doing Building and … optimising data pipelines and APIs between internal systems and third-party partners Improving data quality, automation and consistency across storage and reporting layers Designing and publishing Power BI reports and dashboards to support commercial decision making Exploring opportunities to apply AI and machine learning to improve forecasting and automation Working closely with stakeholders to align data solutions More ❯

Job Number: R Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artifi cia l intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We … need a data professional like you to help our clients find answers in their data to impact important missions-from fraud detection to cancer research to national intelligence. As a Data Engineer at Booz Allen, you'll use your skills and experience to help build advanced technology solutions and implement data engineering activities on some … of the most mission-driven projects in the industry. You'll develop and deploy the pipelines and platforms that organize and make disparate data meaningful. Here, you'll work with a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll sharpen your skills in analytical exploration and More ❯

Data Engineer/Data Engineering/Data Consultant/Lakehouse/Delta Lake/Data Warehousing/ETL/Azure/Azure Databricks/Python/SQL/Based in the West Midlands/Solihull/Birmingham area, Permanent role, £50,000 - 70,000 + car/allowance (£5,000) + 15% bonus. One of … our leading clients is looking to recruit a Data Engineer Azure/Databricks. Location - Hybrid/West Midlands (Birmingham/Solihull) (Candidates must be based within 1 hour of Birmingham) Permanent role Salary £50,000 - 70,000 + car/allowance + bonus Experience: Experience in a Data Engineer/Data Engineering role Large and … complex datasets Azure, Azure Databricks Microsoft SQL Server Lakehouse, Delta Lake Data Warehousing ETL Database Design Python/PySpark Azure Blob Storage Azure Data Factory Desirable: Exposure ML/Machine Learning/AI/Artificial Intelligence More ❯

Duration: 6 Month Job Description: The Senior Developer will be part of the Enterprise Risk Business Technology Office. This role will be responsible for supporting our organization's data-driven initiatives, specifically designing and building a data warehouse solution. This position requires strong experience in data analysis, modeling and engineering with the ability to translate complex technical … solving skills and attention to detail Effective communication and interpersonal skills Ability to work independently and in a team environment Experience: 5 years' extensive knowledge and experience in the Data technologies for Data Analytics, Data Lake/Mart/Warehouse, Databases SQL/NoSQL (DB2, Mongo, Postgres), Big Data Technologies (Spark or PySpark), ETL (Informatica, Talend … experience with Technologies including Web Service API, XML, JSON, JDBC, Java, Python. 3+ years working with SaaS platforms such as Snowflake, Collibra, Mongo/MongoDB Atlas, Knowledge of enterprise data models, information classification, meta-data models, taxonomies and ontologies. Exposure to Full stack enterprise application development (Agular, Spring Boot, Automation testing using Selenium) 5-7 years' experience in More ❯

Position Type: Contract Location: Portland, ME (Onsite) We have an immediate need for a Quality Assurance (QA) Data Engineer reporting to Enterprise Data Platform (EDP) Delivery teams. The initial contract is 6 months with the possibility of an extension based on performance. Location of assignment can be remote only but working EST hours. Experience Level: 5+ years … Job Summary: We are seeking a highly skilled Quality Assurance (QA) Data Engineer to join our Enterprise Data Platform (EDP) Delivery teams. This role involves developing and implementing test strategies, ensuring data accuracy Application performance and integrity, and optimizing data pipelines within the Google Cloud Platform (GCP) ecosystem. The ideal candidate will have a strong … background in data engineering, test automation, and cloud technologies, with expertise in SQL and general understanding of BigQuery and Dataflow. Familiarity with client data and business process, along with proficiency using software management and collaboration tools such as Jira, Confluence, and SharePoint. Key Responsibilities: Partner with Data Engineers, Analysts, and business stakeholders to define quality requirements. Document More ❯

Job Number: R Data Engineer, Mid The Opportunity: Ever-expanding technology like IoT, machine learning, and artifi cia l intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. … We need a data professional like you to help our clients find answers in their data to impact important missions-from fraud detection to cancer research to national intelligence. As a Data Engineer at Booz Allen, you'll use your skills and experience to help build advanced technology solutions and implement data engineering activities on … some of the most mission-driven projects in the industry. You'll develop and deploy the pipelines and platforms that organize and make disparate data meaningful. Here, you'll work with a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll sharpen your skills in analytical exploration More ❯

Titania Solutions Group is seeking a skilled Level III Data Engineer with strong communication skills. The successful candidate will play a critical role in designing, building, and maintaining robust data pipelines, ensuring near real-time data flow, and enabling insightful business intelligence solutions. This is a unique opportunity to work on cutting-edge data architecture … streaming technologies, and advanced analytics solutions that drive key business decisions. This role will be remotely working Eastern Standard Time core hours. Responsibilities: Design, develop, document and maintain scalable data pipelines using Confluent for real-time data streaming. Build and optimize data models and dashboards in Qlik to support business intelligence and reporting needs. Integrate data from various sources, ensuring consistency, accuracy, and timeliness. Collaborate with cross-functional teams, including Data Scientists, Analysts, and Software Engineers, to define data requirements and deliver impactful data solutions. Implement best practices for data ingestion, processing, and storage, focusing on performance and reliability. Monitor and troubleshoot data pipelines, ensuring data quality and operational More ❯

Data Engineer - Databricks Initial 7-month Contract Role Remote Working £600 - £650, Inside IR35 We're partnering with a Global IT Partner who are looking for a Data Engineer to design and develop scalable data pipelines in Azure Databricks. As a Data Engineer, you will be responsible for: Lead end-to-end migration … of data lakes to Azure with a core focus on Databricks Design and implement data pipelines in Azure Databricks, optimising for performance, cost, and scalability Refactor and modernise existing data models to integrate with Power BI Coordinate phased migrations to ensure zero disruption to live operations Replace legacy tools by consolidating workflows within Databricks and native Azure … services Requirements: 10+ years in cloud data engineering, with a strong focus on building scalable data pipelines Expertise in Azure Databricks, including building and managing ETL pipelines using PySpark or Scala Solid understanding of Apache Spark, Delta Lake, and distributed data processing concepts Hands-on experience with Azure Data Lake Storage, Azure Data Factory, and More ❯

Responsibilities Noblis is seeking to hire a Data Engineer with an ACTIVE Top Secret with SCI and Polygraph in Chantilly, VA As a Data Engineer with our team, you will be working with our federal clients to rapidly develop innovative solutions for our clients' immediate mission challenges. In this role, you will work with a team … of developers, data scientists, SMEs, and cyber analysts to design, develop, build, and analyze data management systems. You will work with and analyze our client's challenges and provide solutions by identifying and applying new tools and technologies to help design new data repositories. Working alongside our team and cyber analysts, you will perform data engineering … to identified data sets. As a data engineer your responsibilities will include designing, developing, optimizing, and maintaining data architecture and ETL pipelines. On our team, you will: Develop robust data platforms for analytics platforms. Develop and perform ETL on large datasets. Develop data visualizations to showcase valuable insights extracted from large volumes of data. More ❯

Lead Data Engineer Salary/Rate : £100,000 - £110,000 per annum + Bonus Location : North London Company : Retelligence About Retelligence Retelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver … cutting-edge solutions. Join a dynamic team within a business that values innovation, supports professional development, and offers exceptional career progression. The Role Retelligence is seeking a Lead Data Engineer to take a hands-on role in designing and delivering robust, real-time data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. The company is … particularly interested in candidates with strong expertise in SQL. As the Lead Data Engineer, you’ll play a critical role in shaping their data architecture and driving transformation. You’ll partner closely with engineering, product, and analytics teams to ensure efficient, high-performance data systems that enable the business to thrive in a fast-paced environment. More ❯

Data Engineer Gloucester | up to £54,500 + benefits | Hybrid: 2 days on site We’re supporting a Gloucester-based organisation as they continue to invest in their data capability. They’ve recently implemented Microsoft Fabric, creating an opportunity for a Data Engineer to join at the start of the journey and help shape how … the platform evolves. The role Build and maintain data pipelines using Azure Data Services (Data Factory, Synapse, Databricks). Work in a newly implemented Fabric environment, with the chance to learn and influence best practice from the outset. Collaborate with analysts and business teams to deliver clean, reliable data for reporting and insight. Contribute to the … design and development of the wider data platform. About you Experience with Azure Data Services (Data Factory, Synapse, Databricks or similar). An interest in or exposure to Microsoft Fabric. Strong SQL skills and experience building data pipelines. Comfortable working with stakeholders to understand requirements and deliver solutions. What’s on offer Salary up to More ❯

Lead Data Engineer, Snowflake, 4 months, Remote, CO7368 A leading software consultancy requires a Lead Data Engineer/Tech Lead with strong Snowflake skills - for the next 4 months with the likelihood of significant extension - to provide technical leadership for a prestigious client project to deliver an innovative data platform. Working remotely and outside of … IR35, the Snowflake Lead Data Engineer/Tech Lead will actively work on delivering the technical solutions whilst carrying out code reviews, setting best practices, ensuring code quality, keeping everyone aligned from a technical standpoint, and fostering good communication and collaboration. This will involve: Working with the project owner to gather ongoing requirements from the client Improving the … transparency and traceability of data through well-documented pipelines and clear data lineage. Empowering internal teams with cleaner, structured data, reducing dependence on tribal knowledge and manual interventions. Enabling future scalability by establishing robust, modular foundations Experience Required: Snowflake expertise Solid data engineering expertise including strong SQL and Python Proficiency in DBT for transformation tasks Experience More ❯

Senior Data Engineer Role Overview We are looking for a highly skilled and motivated Senior Data Engineer to join our team and play a pivotal role in the integration of National Disease Registration Services (NDRS) data collections and products into an end-to-end data platform. This is an exciting opportunity to work in … a data rich environment, collaborating closely with engineers, analysts and data scientists to deliver high-impact solutions that support research, public health, and clinical decision-making, Role Scope: Full time hours - 37.5 per week A fixed-term agreement for 6 months A remote work schedule with occasional team meetings is Leeds/London/Birmingham. What you’ll … advanced technologies available. Commitment to Professional Growth: We foster innovation, teamwork, and advancement by offering complimentary training and development to all staff. Key Responsibilities: Develop, construct, test and maintain data and processing workflows to architectural standards. Integrate external or new datasets into existing data pipelines Drive innovation and best practice in data engineering, ensuring solutions are future More ❯

Senior Data Engineer Role Overview We are looking for a highly skilled and motivated Senior Data Engineer to join our team and play a pivotal role in the integration of National Disease Registration Services (NDRS) data collections and products into an end-to-end data platform. This is an exciting opportunity to work in … a data rich environment, collaborating closely with engineers, analysts and data scientists to deliver high-impact solutions that support research, public health, and clinical decision-making, Role Scope: Full time hours - 37.5 per week A fixed-term agreement for 6 months A remote work schedule with occasional team meetings is Leeds/London/Birmingham. What you’ll … advanced technologies available. Commitment to Professional Growth: We foster innovation, teamwork, and advancement by offering complimentary training and development to all staff. Key Responsibilities: Develop, construct, test and maintain data and processing workflows to architectural standards. Integrate external or new datasets into existing data pipelines Drive innovation and best practice in data engineering, ensuring solutions are future More ❯

The Contractor shall analyze requirements and design, code, test, debug, and document data pipelines. The Contractor shall have the ability to create and integrate application programming interfaces (APIs). Their technical skills generally include multiple programming languages and a deep knowledge of SQL database design. The data engineer role requires a more in-depth knowledge in programming … for integrating complex models and using advanced software library frameworks to distribute large, clustered data sets. Data engineers collect and arrange data in a form that is useful for analytics. Data Engineers should be familiar with both streaming and batch models of data movement, aware of the trade-offs between the two, and able to … apply that knowledge to solve for business and operational problems. The Contractor shall perform the following tasks: • Developing, maintaining, and testing infrastructures for data generation to transform data from various structured and unstructured data sources. • Develop complex queries to ensure accessibility while optimizing the performance of NoSQL and/or big data infrastructure. • Create, document, and More ❯

Data Engineer £500 - £560 per day London - 1 day per week in office We're working with a leading global healthcare technology company who are building out their next-generation data platform, with a strong emphasis on automation, testing, and cloud-native engineering, and are looking for an experienced Data Engineer to join their team. … The Role You'll be part of a modern data engineering function that's implementing best-in-class data practices across ingestion, transformation, and orchestration layers. The environment is highly technical, collaborative, and fast-paced, giving you the opportunity to work across a wide variety of data sources and tools. Day-to-day responsibilities include: Designing and … developing DBT models and Airflow pipelines within a modern data stack. Building robust data ingestion pipelines across multiple sources - including external partners, internal platforms, and APIs. Implementing automated testing and CI/CD pipelines for data workflows. Performing data extraction and enrichment, including web scraping and parsing of unstructured text (e.g., scanned forms and documents). More ❯

Data Engineer SME - Huntsville, AL Full Visibility is seeking a Data Engineer Subject Matter Expert (SME) to work in Huntsville, AL. Candidate must possess an active Top Secret/SCI Eligible clearance. The Data Engineer SME will be responsible for engineering in support of an advanced visual analytic application that includes developing data … software, facilitating the bulk analysis of relational information utilizing advanced graphics, visualization, and high-performance computing, as well as using the specified open source, COTS, and GOTS technologies. The Data Engineer SME will establish an application that produces manageable, actionable intelligence from streams of structured and semi-structured data; design strategies for enterprise database systems and set … systems with existing warehouse structure and refine system performance and functionality. FV REQ Requirements •Active Top Secret/SCI Eligibility Clearance •At least ten (10+) years of experience providing data engineering or related work •Experience with Java, Python, Shell Scripting, Oracle & Data Warehousing, and Informatica •Robust decision-making skills and domain knowledge •Bachelor's Degree in related field More ❯

Robert Half Technology are assisting a global Pharmaceutical organisation to recruit a Data Engineer on a contract basis - Hybrid Working - London based - Outside IR35 Deep expertise in Snowflake and DBT to join a mission-driven analytics team. This role is critical to assessing and improving an established Snowflake environment, driving cost optimisation, enhancing operational rigour, and supporting the … team's move toward predictive analytics and ML Ops workflows. Role The Data Engineer will own and assess the Snowflake platform, proposing and executing optimisation around performance, cost, scalability, and architecture improvements. Lead DBT development and maintenance, with emphasis on test frameworks, transformation efficiency, and eliminating redundant or resource-heavy flows (e.g., excessive temp table usage). Design … implement, and maintain CI/CD pipelines to automate reliable deployment of data transformations. Provide deep insight into Snowflake infrastructure, including cost and pricing models, performance tuning, and resource governance. Support ML Ops/predictive analytics operationalisation - managing updates, performance monitoring, and change rollout rather than building models from scratch. Be a technical mentor and knowledge resource within the More ❯

Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP OB have partnered with a UK FinTech Unicorn, who's Data function is undergoing rapid growth, and in-turn are looking to grow their Data team, with 2 highly skilled Data Engineers. You'll be working on shaping the companies Data function … driving Data best practices, and collaborate with a variety of stakeholders to ensure the company are making Data driven decisions. Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP Tech Stack: Python & SQL DBT, AirFlow & BigQuery AWS/GCP ETL Pipelines Base salary of £90k-£115k depending on skills and experience Excellent overall … a sizeable bonus and stock options Hybrid working in Central London with 1-2 days a week required You must be UK based, and sadly sponsorship is unavailable Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they’re able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You’ll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation … and support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to More ❯

Are you a skilled Data Engineer looking to step into the world of architecture An exciting opportunity has opened for an experienced Data Engineer to join our national Data & Analytics function at a time of significant technical modernisation. The team is about to embark on a greenfield project to build a futureproof data warehousing … platform using Azure Data Factory and Databricks, with a clear focus on scalability, quality, and best practice.Working within a specialist Data Platform & Engineering team, you’ll join as the expert within Azure Databricks. You'll help to upskill our teams knowledge of Databricks, get involved in data modelling and ETL pipeline development, integrations, and performance tuning. This … is an ever evolving project as the business becomes more and more data driven and your knowledge of Databricks will be pivitol in shaping the architecture. This is an ideal role for a Senior Data Engineer ready to step into an architectural role, or an established architect keen to take ownership of a highly visible and strategic More ❯

Data Engineer (Microsoft Azure) Location: London/Hybrid 2-3 days in office Type: 6 months contract Rate: £250 to £275/a day PAYE About the Role We are seeking a Data Engineer to support the design, build, and maintenance of modern data solutions on the Microsoft Azure platform. You will play a key … role in ensuring data is accessible, secure, and efficient, while collaborating with stakeholders to deliver solutions that meet strategic business needs. This is an exciting opportunity for someone motivated to learn, develop, and contribute to large-scale transformation initiatives in a dynamic environment. Key Responsibilities Support the development of data pipelines and storage solutions Assist in mapping and … migrating data constructs into the Bank's approved Fabric instance. Contribute to documentation and artefacts that support engineering efforts. Collaborate with senior engineers to establish an operational data model for front-office operations. Participate in Proof of Concept (PoC) development for data storage and transformation solutions. Support the Business Entity Mastering (BEM) to Fabric transformation through pipeline More ❯