301 to 325 of 594 Permanent Data Engineer Jobs

Senior Data Engineer Wiltshire - 3 days in office £65,000 About The Company The company operates in both B2B and D2C markets, providing food solutions to institutions and individuals. With over 30 years of experience and a presence in 400 markets, it leverages data-driven insights, forensic analytics, and predictive modelling to enhance business performance. The Role … The team is responsible for making data reliable, consistent, persistent, and available for analysts through self-service platforms such as Tableau, Power BI, and SSRS. Within the team, this role will focus on data infrastructure management to ensure system reliability and availability. The day to day will include: Ensuring system availability and reliability to support business operations. Leading … internal development projects to enhance infrastructure and free up resources for strategic improvements. Analysing data to understand differences, ensuring accuracy, and improving data validation processes. Handling data quality and migration projects to enhance system performance and integrity. Supporting the deployment of machine learning models using Databricks and PySpark. Managing and optimising cross-functional ETL processes across More ❯

Data Engineer - SME Position Overview As a Subject Matter Expert (SME) Data Engineer, you will provide technical leadership on major tasks and technology assignments for a federal law enforcement customer. You will establish goals and plans that meet project objectives while leveraging your expertise in data engineering, particularly for forensic and investigative ecosystems. Your decision … making and domain knowledge will have a critical impact on overall project implementation. Key Responsibilities • Design and implement data pipelines and ETL processes to support the cyber investigative capabilities • Develop and maintain data analytics solutions for desktop and web-based visual analytic applications • Establish applications that produce manageable, actionable intelligence from streams of structured, semi-structured, and data … Provide technical leadership and mentorship to other team members • Participate in Program Increments (PIs) and Agile Release Train (ART) activities Required Technical Skills Expert-level proficiency with: • Python for data processing and ETL workflows • SQL (MySQL, PostgreSQL, Microsoft SQL) • Elasticsearch • Data pipeline technologies (Apache Kafka, Apache Nifi, Cribl) • Splunk for data analysis and visualization • Containerization technologies (Docker More ❯

Data Engineer – Azure/Databricks/Snowflake 📍 Remote (UK/EU based) | ⏳ 6–12 months | 💷 Competitive Day Rate We are supporting a leading client in Financial Services who are at the early stages of building a new enterprise Data Lake on Azure Cloud . To deliver this programme, we’re looking for experienced Contract Data Engineers … with proven expertise in Databricks and Snowflake , available for immediate engagement. The role: Design, build, and optimise data pipelines and ETL processes on Azure Databricks Implement scalable, high-performance data models in Snowflake Work closely with architects and stakeholders to define data architecture, storage, and integration patterns Contribute to the build of a secure, production-ready Data Lake from the ground up Support best practices across data quality, governance, and CI/CD You will bring: Strong commercial experience as a Data Engineer End-to-end project exposure, ideally from greenfield/early-stage Data Lake builds Deep hands-on knowledge of Databricks (Spark, Delta Lake, ML pipelines) and Snowflake (warehousing, optimisation More ❯

Data Engineer – Azure/Databricks/Snowflake 📍 Remote (UK/EU based) | ⏳ 6–12 months | 💷 Competitive Day Rate We are supporting a leading client in Financial Services who are at the early stages of building a new enterprise Data Lake on Azure Cloud . To deliver this programme, we’re looking for experienced Contract Data Engineers … with proven expertise in Databricks and Snowflake , available for immediate engagement. The role: Design, build, and optimise data pipelines and ETL processes on Azure Databricks Implement scalable, high-performance data models in Snowflake Work closely with architects and stakeholders to define data architecture, storage, and integration patterns Contribute to the build of a secure, production-ready Data Lake from the ground up Support best practices across data quality, governance, and CI/CD You will bring: Strong commercial experience as a Data Engineer End-to-end project exposure, ideally from greenfield/early-stage Data Lake builds Deep hands-on knowledge of Databricks (Spark, Delta Lake, ML pipelines) and Snowflake (warehousing, optimisation More ❯

Description Location: McLean, VA Clearance Required: TS/SCI with Full Scope Polygraph (FSP) Position Type: Full-Time, On-Site We are seeking a highly skilled Data Engineer (SME) to support a mission-critical Sponsor program. The ideal candidate will bring expertise in designing, developing, and deploying data pipelines and cloud-native infrastructure to enable enterprise-scale … with Python, Terraform, and AWS is required, along with a background in DevSecOps practices and automated testing to ensure scalability, performance, and compliance. Primary Responsibilities: Design, develop, and maintain data pipelines and workflows for large-scale enterprise environments. Utilize Python and Bash for automation, data engineering, and system integration tasks. Implement Terraform to provision, configure, and manage cloud … infrastructure in AWS. Manage data science and analytics environments using tools such as Anaconda. Develop and integrate CI/CD pipelines with automated testing to ensure high-quality, secure deployments. Support AI/ML modeling workflows by enabling scalable, secure, and performant data pipelines. Collaborate with mission stakeholders, analysts, and developers to align requirements with technical solutions. Apply More ❯

into the next exciting chapter: integrating advanced artificial intelligence to redefine how robotics can transform healthcare. About the Role We are looking for a talented and mission-driven Senior Data Engineer to design and maintain scalable data infrastructure for real-time, image-guided medical robotics applications. You will work hands-on with AI scientists, clinical and imaging … specialists, building robust data pipelines that power AI workflows and integrate seamlessly with our robotic systems Key Responsibilities Design and implement scalable data pipelines for real-time and batch processing Build and maintain data lakes, warehouses, and streaming platforms Develop architectures that support AI workflows and integration with clinical/robotic software Data Operations and Quality … Ensure reliability, scalability, and high performance of data systems Implement data versioning, lineage tracking, and reproducibility practices Define data engineering standards and best practices aligned with medical device requirements Monitor data quality, availability, and integrity across platforms Manage backups, disaster recovery, and incident response Compliance & Governance Ensure compliance with healthcare data privacy regulations (GDPR, HIPAA More ❯

Data Engineering Lead (Azure) London (3 days in office) Up to £105,000 + 5% Bonus + Benefits Are you ready to take the lead on building a cutting-edge data platform? We're seeking a Data Engineering Lead to shape and grow data engineering capabilities at a global, forward-thinking organisation. This is a greenfield … architect a modern Azure-based platform, lead a talented team, and make a direct impact on business-wide decision making. Why this role? Spearhead the creation of a new data platform from the ground up. Balance hands-on engineering with team leadership and mentoring. Collaborate with analysts, data scientists, and business leaders to deliver impactful solutions. Hybrid working … week , remote flexibility the rest. Join a supportive and inclusive culture, with a global footprint and a focus on innovation. What you'll be doing: Designing and building scalable data pipelines to support analytics, reporting, and machine learning. Leading the implementation of Azure data solutions and ensuring robust ETL/ELT processes. Defining architecture strategies that allow for More ❯

Junior Data Engineer – Systematic Commodities - Multi Billion Dollar Hedge Fund - London We are working with a leading global investment platform to hire a Junior Data Engineer/Scientist for their Systematic Commodities team. This is a rare opportunity to work shoulder-to-shoulder with quant researchers, developers, and a portfolio manager in a high-performing team. … of a collaborative environment that values intellect, grit, and ownership. What You’ll Do Onboard new datasets into the research ecosystem — ingestion, cleaning, and enriching with metadata. Build scalable data pipelines and validation processes with the developer. Oversee daily data operations critical to trading. Combine statistical techniques, research insights, and intuition to engineer new data features. … Develop visualisations and reports that directly support portfolio management. Process and incorporate unstructured data such as reports and market commentary. What You’ll Bring 2+ years’ experience in a tech or finance role working with varied datasets. Outstanding academic performance at Bachelors or Masters level in STEM, Finance/Economics, or Computer Science. Strong programming skills in Python and More ❯

Junior Data Engineer – Systematic Commodities - Multi Billion Dollar Hedge Fund - London We are working with a leading global investment platform to hire a Junior Data Engineer/Scientist for their Systematic Commodities team. This is a rare opportunity to work shoulder-to-shoulder with quant researchers, developers, and a portfolio manager in a high-performing team. … of a collaborative environment that values intellect, grit, and ownership. What You’ll Do Onboard new datasets into the research ecosystem — ingestion, cleaning, and enriching with metadata. Build scalable data pipelines and validation processes with the developer. Oversee daily data operations critical to trading. Combine statistical techniques, research insights, and intuition to engineer new data features. … Develop visualisations and reports that directly support portfolio management. Process and incorporate unstructured data such as reports and market commentary. What You’ll Bring 2+ years’ experience in a tech or finance role working with varied datasets. Outstanding academic performance at Bachelors or Masters level in STEM, Finance/Economics, or Computer Science. Strong programming skills in Python and More ❯

Junior Data Engineer – Systematic Commodities - Multi Billion Dollar Hedge Fund - London We are working with a leading global investment platform to hire a Junior Data Engineer/Scientist for their Systematic Commodities team. This is a rare opportunity to work shoulder-to-shoulder with quant researchers, developers, and a portfolio manager in a high-performing team. … of a collaborative environment that values intellect, grit, and ownership. What You’ll Do Onboard new datasets into the research ecosystem — ingestion, cleaning, and enriching with metadata. Build scalable data pipelines and validation processes with the developer. Oversee daily data operations critical to trading. Combine statistical techniques, research insights, and intuition to engineer new data features. … Develop visualisations and reports that directly support portfolio management. Process and incorporate unstructured data such as reports and market commentary. What You’ll Bring 2+ years’ experience in a tech or finance role working with varied datasets. Outstanding academic performance at Bachelors or Masters level in STEM, Finance/Economics, or Computer Science. Strong programming skills in Python and More ❯

Junior Data Engineer – Systematic Commodities - Multi Billion Dollar Hedge Fund - London We are working with a leading global investment platform to hire a Junior Data Engineer/Scientist for their Systematic Commodities team. This is a rare opportunity to work shoulder-to-shoulder with quant researchers, developers, and a portfolio manager in a high-performing team. … of a collaborative environment that values intellect, grit, and ownership. What You’ll Do Onboard new datasets into the research ecosystem — ingestion, cleaning, and enriching with metadata. Build scalable data pipelines and validation processes with the developer. Oversee daily data operations critical to trading. Combine statistical techniques, research insights, and intuition to engineer new data features. … Develop visualisations and reports that directly support portfolio management. Process and incorporate unstructured data such as reports and market commentary. What You’ll Bring 2+ years’ experience in a tech or finance role working with varied datasets. Outstanding academic performance at Bachelors or Masters level in STEM, Finance/Economics, or Computer Science. Strong programming skills in Python and More ❯

Junior Data Engineer – Systematic Commodities - Multi Billion Dollar Hedge Fund - London We are working with a leading global investment platform to hire a Junior Data Engineer/Scientist for their Systematic Commodities team. This is a rare opportunity to work shoulder-to-shoulder with quant researchers, developers, and a portfolio manager in a high-performing team. … of a collaborative environment that values intellect, grit, and ownership. What You’ll Do Onboard new datasets into the research ecosystem — ingestion, cleaning, and enriching with metadata. Build scalable data pipelines and validation processes with the developer. Oversee daily data operations critical to trading. Combine statistical techniques, research insights, and intuition to engineer new data features. … Develop visualisations and reports that directly support portfolio management. Process and incorporate unstructured data such as reports and market commentary. What You’ll Bring 2+ years’ experience in a tech or finance role working with varied datasets. Outstanding academic performance at Bachelors or Masters level in STEM, Finance/Economics, or Computer Science. Strong programming skills in Python and More ❯

and more, aiming to transform traditional business models with cutting-edge digital solutions. Know more about us: https://corporate.jd.com/Key Responsibilities: Build real-time/offline data pipelines (ETL) using Hadoop/Spark/Flink Design data storage solutions (warehouses/lakes) for multi-source heterogeneous data Implement data quality monitoring and SQL … optimization Minimum Qualifications Bachelor’s+ in Data Science, CS, or Statistics 3+ years data engineering experience Proficiency in big data technologies and data modeling English as working language preferred Preferred Qualifications Experience in risk/cross-border data systems Stream processing expertise (e.g., Flink) Certifications: AWS Data Analytics, Google Cloud Data Engineer More ❯

and more, aiming to transform traditional business models with cutting-edge digital solutions. Know more about us: https://corporate.jd.com/Key Responsibilities: Build real-time/offline data pipelines (ETL) using Hadoop/Spark/Flink Design data storage solutions (warehouses/lakes) for multi-source heterogeneous data Implement data quality monitoring and SQL … optimization Minimum Qualifications Bachelor’s+ in Data Science, CS, or Statistics 3+ years data engineering experience Proficiency in big data technologies and data modeling English as working language preferred Preferred Qualifications Experience in risk/cross-border data systems Stream processing expertise (e.g., Flink) Certifications: AWS Data Analytics, Google Cloud Data Engineer More ❯

and more, aiming to transform traditional business models with cutting-edge digital solutions. Know more about us: https://corporate.jd.com/Key Responsibilities: Build real-time/offline data pipelines (ETL) using Hadoop/Spark/Flink Design data storage solutions (warehouses/lakes) for multi-source heterogeneous data Implement data quality monitoring and SQL … optimization Minimum Qualifications Bachelor’s+ in Data Science, CS, or Statistics 3+ years data engineering experience Proficiency in big data technologies and data modeling English as working language preferred Preferred Qualifications Experience in risk/cross-border data systems Stream processing expertise (e.g., Flink) Certifications: AWS Data Analytics, Google Cloud Data Engineer More ❯

and more, aiming to transform traditional business models with cutting-edge digital solutions. Know more about us: https://corporate.jd.com/Key Responsibilities: Build real-time/offline data pipelines (ETL) using Hadoop/Spark/Flink Design data storage solutions (warehouses/lakes) for multi-source heterogeneous data Implement data quality monitoring and SQL … optimization Minimum Qualifications Bachelor’s+ in Data Science, CS, or Statistics 3+ years data engineering experience Proficiency in big data technologies and data modeling English as working language preferred Preferred Qualifications Experience in risk/cross-border data systems Stream processing expertise (e.g., Flink) Certifications: AWS Data Analytics, Google Cloud Data Engineer More ❯

and more, aiming to transform traditional business models with cutting-edge digital solutions. Know more about us: https://corporate.jd.com/Key Responsibilities: Build real-time/offline data pipelines (ETL) using Hadoop/Spark/Flink Design data storage solutions (warehouses/lakes) for multi-source heterogeneous data Implement data quality monitoring and SQL … optimization Minimum Qualifications Bachelor’s+ in Data Science, CS, or Statistics 3+ years data engineering experience Proficiency in big data technologies and data modeling English as working language preferred Preferred Qualifications Experience in risk/cross-border data systems Stream processing expertise (e.g., Flink) Certifications: AWS Data Analytics, Google Cloud Data Engineer More ❯

Title: Senior Snowflake Data Engineer Location: London (2-3 days on site) Salary: Up to £75,000 iO Associates is looking for an experienced Senior Snowflake Data Engineer to join a fast-growing, next-generation technology consultancy delivering cutting-edge data, AI, and cloud solutions to high-profile clients. This is an exciting opportunity to … work on impactful projects, lead delivery squads, and develop your leadership skills while staying hands-on with modern data technologies. What You'll Do Lead technical delivery of data engineering projects within client teams, ensuring high-quality, scalable solutions. Work closely with stakeholders to understand requirements, design solutions, and plan delivery. Build and optimise data pipelines, architectures … on cloud platforms. Provide technical guidance and mentorship to team members. Promote engineering excellence and contribute to internal knowledge sharing. What We're Looking For 5+ years' experience in data engineering, building and optimising large-scale cloud-based solutions (AWS, Azure, or GCP). Strong Snowflake expertise (Snowpipe, Snowpark, Dynamic Tables, UDFs) - SnowPro certification desirable. Advanced Python and SQL More ❯

Make your mark in a collaborative and purpose-driven team.** We are seeking a Senior AWS Data Engineer to join a leading organisation's AWS - Data team. This permanent, hybrid position requires you to work in the office two-three days a week in London. This is a great opportunity for candidates who are passionate about data engineering and want to contribute to impactful projects in a supportive environment. **Key Responsibilities:**- Develop and maintain AWS data pipelines and infrastructure.- Collaborate with cross-functional teams to design data solutions.- Optimise existing data processes for efficiency and performance.- Ensure data quality and security standards are met.- Stay up-to-date with AWS developments and … best practices.**Key Requirements:**- Proven experience with AWS services and tools.- Strong knowledge of data modeling and ETL processes.- Proficiency in programming languages such as Python or SQL.- Excellent problem-solving skills with a proactive approach.- Ability to communicate effectively within a team.If you are a skilled and driven AWS Data Engineer looking to make an impact More ❯

Make your mark in a collaborative and purpose-driven team.** We are seeking a Senior AWS Data Engineer to join a leading organisation's AWS - Data team. This permanent, hybrid position requires you to work in the office two-three days a week in London. This is a great opportunity for candidates who are passionate about data engineering and want to contribute to impactful projects in a supportive environment. **Key Responsibilities:** - Develop and maintain AWS data pipelines and infrastructure. - Collaborate with cross-functional teams to design data solutions. - Optimise existing data processes for efficiency and performance. - Ensure data quality and security standards are met. - Stay up-to-date with AWS developments and … best practices. **Key Requirements:** - Proven experience with AWS services and tools. - Strong knowledge of data modeling and ETL processes. - Proficiency in programming languages such as Python or SQL. - Excellent problem-solving skills with a proactive approach. - Ability to communicate effectively within a team. If you are a skilled and driven AWS Data Engineer looking to make an More ❯

Data Engineer - PySpark - Palantir - London - £75K Join a dynamic team dedicated to innovative data solutions in Soho! We are seeking a Data Engineer with expertise in PySpark to play a pivotal role as the team and business grow. This permanent, hybrid position offers a unique opportunity to contribute to impactful projects while enjoying a supportive … and collaborative work environment.Key Responsibilities:- Develop and optimise data pipelines using PySpark to ensure efficient data processing- Collaborate with cross-functional teams to deliver high-quality, data-driven insights- Engage in continuous learning and implement best practices in data management- Participate in the deployment and maintenance of data solutions within the Microsoft ecosystemThe ideal candidate … will have strong analytical skills and a passion for data engineering. You will thrive in a setting that values innovation and teamwork. Salary is up to £75,000 plus share options.If you are ready to make a meaningful impact and grow your career, we encourage you to apply for this exciting opportunity More ❯

Data Engineer - PySpark - Palantir - London - 75K Join a dynamic team dedicated to innovative data solutions in Soho! We are seeking a Data Engineer with expertise in PySpark to play a pivotal role as the team and business grow. This permanent, hybrid position offers a unique opportunity to contribute to impactful projects while enjoying a supportive … and collaborative work environment. Key Responsibilities: - Develop and optimise data pipelines using PySpark to ensure efficient data processing - Collaborate with cross-functional teams to deliver high-quality, data-driven insights - Engage in continuous learning and implement best practices in data management - Participate in the deployment and maintenance of data solutions within the Microsoft ecosystem The … ideal candidate will have strong analytical skills and a passion for data engineering. You will thrive in a setting that values innovation and teamwork. Salary is up to 75,000 plus share options. If you are ready to make a meaningful impact and grow your career, we encourage you to apply for this exciting opportunity More ❯

Data Engineer - PySpark - Palantir - London - £75K Join a dynamic team dedicated to innovative data solutions in Soho! We are seeking a Data Engineer with expertise in PySpark to play a pivotal role as the team and business grow. This permanent, hybrid position offers a unique opportunity to contribute to impactful projects while enjoying a supportive … and collaborative work environment. Key Responsibilities: - Develop and optimise data pipelines using PySpark to ensure efficient data processing - Collaborate with cross-functional teams to deliver high-quality, data-driven insights - Engage in continuous learning and implement best practices in data management - Participate in the deployment and maintenance of data solutions within the Microsoft ecosystem The … ideal candidate will have strong analytical skills and a passion for data engineering. You will thrive in a setting that values innovation and teamwork. Salary is up to £75,000 plus share options. If you are ready to make a meaningful impact and grow your career, we encourage you to apply for this exciting opportunity More ❯

programs that transform their business operations through a variety of IT solutions. We're the talent behind the technology. To find out more about ECCO visit . Job Title: Data Engineer Location: Leawood, KS (hybrid) OR Alexandria, VA (mainly remote) Duration: Direct Hire Benefits: Medical/Dental/Vision/401k/PTO/Holidays Job Description: • Design … build, and maintain scalable data pipelines using tools like Apache NiFi, Airflow, or equivalent orchestration systems. • Work with structured and semi-structured data using SQL and NoSQL systems (e.g., PostgreSQL, MongoDB, Elasticsearch, Neo4j). • Develop services and integrations using Java (primary) and optionally Python for ETL workflows and data transformation. • Integrate data from internal and external … REST APIs; handle data format translation (e.g., JSON, Parquet, Avro). • Optimize data flows for reliability and performance, and support large-scale batch and streaming data jobs. • Implement and document ETL mappings, schemas, and transformation logic aligned with mission use cases. • Collaborate with software, DevOps, and AI teams to support downstream data science and ML workflows. More ❯

Data Engineer (Junior - Senior) | UK Remote We're recruiting for a leading UK geospatial solutions provider seeking talented Data Engineers to join their Data & Research team. This role spans designing, building, and optimizing ETL pipelines and data infrastructure to deliver high-quality geospatial data products. Opportunities exist across Junior, Mid-Level, and Senior levels. … What you'll do: Develop, maintain, and automate ETL pipelines for data ingestion, transformation, and delivery. Work with cloud platforms, modern data engineering tools, and geospatial technologies. Contribute to research, innovation, and data product development. Ensure high-quality standards, testing, and documentation. Collaborate across teams and liaise with partners and data suppliers. What we're looking … for: Degree or equivalent in GIS, Computer Science, or related field. Experience in geospatial data management and ETL development (Python, FME, GDAL, PostGIS). Knowledge of GIS platforms (ArcGIS, QGIS, GeoServer). Strong problem-solving, communication, and teamwork skills. Ability to work independently and embrace new technologies. Why join: Flexible home-based/remote working. Career progression from Junior More ❯