1 to 25 of 447 Permanent Data Engineering Jobs in England

The role will be critical in ensuring data quality, consistency, and reliability for SPW. The role will also provide ample development opportunities, in particular progressing our new Data Lakehouse and implementing an iPaaS solution. Location | Leeds, West Yorkshire Salary | £50,000 - £55,000 Key Responsibilities: Maintenance of existing … data pipelines; pre-empting issues and responding to any incidents in a timely, professional manner. Development of new pipelines as per business requests or to stabilise the current operating environment. Liaising with other areas across the business to help define requirements for new projects, including both pipeline and ETL … key processes. Core Skills/Competencies Languages - Expert in SQL (Postgres, Athena Presto SQL) and proficient in using Python to build, maintain and orchestrate data pipelines across the business. Amazon AWS - Experience using a serverless approach primarily utilising Lambda Functions, Glue (Jobs, Crawlers, Catalogues), Step Functions, SNS (notifications), SQS more »

Are you an experienced Data Engineer, looking for a new and exciting challenge? Baltic Recruitment are currently recruiting for a Permanent Data Engineer, for a client located in Washington. The Data Engineer will provide vital assistance to the Senior Business and Data Analyst, as part of … the overall digital transformation and data analysis team within the business. Data Engineer Duties & Responsibilities: Supporting in the business wide digital transformation process Develop and maintain Microsoft Azure infrastructure in line with business needs Assist in mapping the data requirements from source to useable output Automate data reporting processes Ensure the agreed project management methods, standards and processes are maintained throughout the project lifecycle Assist the Senior Business & Data Analyst in the production and maintenance of project plans Adapt to learn requirements from different departments and to collaborate with business stakeholders on various levels Working more »

Role: Lead Data Solution Architect Location: London (Can be hybrid) Job type: Full time Salary: GBP90K Job Description: Job Title: Lead Data Solution Architect Dimensions: Provide quantitative examples: Financial Reports to: Head of Data Architecture Reports: 0 Department: Data & Analytics Date: Date that the document is … completed Location: Any Job Description Summary To lead the data architectural elements and resources on how we collect, structure, and use our data across the business area. The Data Architect will conceive and design the data structures and integrations that enable us to rapidly, efficiently and … deliver on our objectives. Finally, you will define and own the solution architecture documents that explains in detail the how, what and when for data across your business area, including in our data lake/platform and operational data systems. Responsibilities Data architectural accountability: For how more »

Staff Engineer (Data Engineering) A leading tech & data company are looking for a Staff Engineer within their Data Engineering function to provide architectural expertise and guidance on overall solutions to be delivered. You will be working on operational excellence and supporting the extensive data platform and also the bespoke streaming platform. This is a permanent role based in central London with a hybrid working model. Role: The data engineering team manages and works on multiple streams and projects that have a high impact and importance for the business. This role will … sit within the Core Data Platform (CDP) team, which is split into two teams, our Platform team that focuses on operational excellence and supporting our extensive data platform and our Streaming team that supports our bespoke streaming platform. As a Staff Engineer, you will assume a key position more »

About the job My client is seeking a dynamic Lead Data Engineer with robust data architecture and warehousing skills to lead their Data Engineering team. Being a leading financial institution, data fuels their operations and growth. being pivotal in ensuring data is expertly modelled … ingested, transformed, and accessible organisation-wide. Responsibilities: Team Leadership: Mentor and develop our Data Engineering team. Strategy Development: Shape and implement our data engineering strategy. Data Architecture: Define and implement solutions within our Data Vault framework. Cross-Functional Collaboration: Partner with data science … credit risk, and analytic teams to meet their data needs. Customer Data Platform: Manage our Rudderstack-based platform for comprehensive Customer 360 views. Quality Assurance: Ensure CI/CD and test automation with robust observability. Cost Management: Optimise data platform costs within budget. Supplier Management: Maintain strong more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data more »

Senior Data Engineer (GCP) My client a financial services business are looking for a Senior Data Engineer (GCP), to spearhead global initiatives to migrate complex data systems to GCP. You will design, implement, and optimise data pipelines, ensuring data integrity during migration and utilising GCP … services for scalable and efficient data transformation. Salary: Up to £65K Hybrid: 2 days a week Key Responsibilities: Lead data engineering projects in Europe, working with partners for GCP transition. Design and deploy data pipelines with automated data lineage. Develop reusable data engineering … Ensure timely migration to GCP. Essential Qualifications: 5 years of SQL. 3 years of GCP and its different services. Experience with microservice architecture and data processing pipeline design. Desired Qualifications: Certification in GCP. Financial Services experience. Experience coaching and mentoring data engineers. If this role is of interest more »

Senior Data Engineer £50-£60k DOE Mainly Remote working, in office twice a month in Exter offices. The company : Manages a wide portfolio of leading PropTech businesses across various markets and technology platforms. With well-known application suites, online services, and extensive national property data, along with premier … winning solutions to estate agencies, conveyancing, surveying, lender valuations, land asset management, environmental consultancy, and Government markets. The Opportunity : This senior role in the Data department is ideal for an experienced Data Engineer to work on their modern Data platform. Currently undergoing an ambitious data transformation … to shape the future of Data and revolutionize the property industry. This role is diverse and involves creating data-as-product solutions, including: Assembling large, complex data sets that meet functional and non-functional business needs Building infrastructure for optimal data extraction, transformation, and loading from more »

Our client, an exciting start-up customer obsessed behavioural agency founded by two huge names in the data space (that have grown teams previously to 400), is looking for a personable and hard-working Junior Data Engineer to design, build, and maintain a variety of solutions including warehousing … drive real business results, a stark contrast to the generic approaches often found at larger agencies. Leading with Relationships and Results As a Junior Data Engineer, you'll leverage your knowledge of data warehousing and Google Cloud Platform (GCP) to design and build data pipelines. You'll … combine your technical skills in data modelling and transformation with your expertise in cloud-based data services like BigQuery and Dataflow. What will you be doing? Data Engineering in Google BigQuery: Design, build, test, and deploy data models and transformations for efficient data analysis. more »

System Analyst Job Location :: London, UK (HYBRID) Work Type :: Contract We are looking for Senior level UK based BSA with Deep London market and Data projects experience. Senior Business Systems Analyst Job Description Summary In this role you will form part of a high performing agile squad where alongside … the Data Engineering Manager and Principal Product Manager you will lead the gathering of requirements for our new Snowflake data platform. Your solutions will be critical to our data and analytics domain and to the continued success of the company. Job Description In this role you … will Act as a data subject matter expert for our new data platform, supporting business users and IT colleagues. Work with business stakeholders to understand their data requirements and document them at an appropriate level. Once agreed then translate these into stories and tasks for development. Utilise more »

in digital avatars and human clones. Role: MLOps Engineer Location: London Salary: Up to £100,000 Responsibilities: Develop ML Pipelines: Build and maintain scalable data processing systems. Ensure data quality and integrity. Automate ML Processes: Integrate machine learning solutions into existing systems and automate workflows. Deploy and Scale … and implementation practices. Ensure Security: Adhere to security and compliance standards in ML deployments. Requirements: Education: Bachelor s or Master s in Computer Science, Data Science, or related field. Experience: 2-3 years in ML, data engineering, or MLOps. Abilities: Strong analytical, problem-solving, and communication skills. … Skills: Proficient in Python, ML frameworks like TensorFlow or PyTorch. Experienced with CI/CD, Docker, Kubernetes, and data pipeline tools like Airflow. more »

Full Stack Developer/Data Engineer opportunity. Full time permanent position. Fully remote or hybrid - office just outside of London. My client is a dynamic and rapidly growing electrification company dedicated to the decarbonisation of heat transport and induction. They have years of experience from across the energy sector … in integrating and connecting renewable generation, EV charging and the digitalisation of energy. They are seeking a Full Stack Developer/Data Engineer with Data bricks expertise to help tackle exciting challenges in the energy sector. In this role, you will: Develop and scale energy solutions: Bring ideas … to life, building robust and scalable applications from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance user applications for real-world more »

and Key Results (OKRs) Prioritising work and decisively resolve trade-offs with peers and senior leaders Effectively documenting and explaining new requirements to the engineering team using user stories with acceptance criteria and help the team in breaking down complex work into smaller, deliverable chunks of value that can … be delivered faster. Steering sprint/release planning sessions by working with the engineering counterparts to plan sprints/releases that deliver maximum business value in least effort Driving the acceptance and adoption of ideas and improvements with product teams and engineering stakeholders Prioritising, coordinating and communicating the … of the broader Product team (Product Managers, Designers, Analysts, and Researchers) Security Engineers & Security Analysts and other partners within the Cyber Security team Engineers & Data Scientists and other partners in Technology Business stakeholders across Tesco People, budgets and other resources I am accountable for in my job: Budget paper more »

a holistic and multi-disciplinary approach to each of these mega processes. As part of Shepherd, a new role has been created to lead Data & Analytics within those process areas. What are we looking for? Bachelor s degree or Equivalent (IT Degree preferred in particular computer science, Data … to Retire (HR) Experience working in sizeable and complex digital transformations in large global organizations resulting in high adoption of new tools Experience in Data cleansing/enrichment/migration along with over Data & Analytic skills. Hands-on data engineering/development experience, preferably in a … cloud/big data environment Able to manage expectations in an ambiguous and fast-paced environment and deliver excellence Strong people management skills with a track record of nurturing high-performing teams Excellent communication skills, capable of distilling complex concepts for a variety of audiences Demonstrated proactive and results more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to start … interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading more »

employees, they are always looking to adapt to technological changes to stay at the forefront of the industry About the Role: As a Principal Data Engineer, you ll play a pivotal role to help drive the adoption of Microsoft Power platform and streamline reporting and analytics processes across the … organisation, we are looking for a Data Engineer with extensive multi-cloud data engineering experience and in-depth understanding of end-to-end development and deployment processes. Whilst this is a data engineer role, the focus is on data analytics and migrating from Tableau to … Power BI. Experience/skills required: Proficient in data analysis, data modelling and designing ETL processes. Familiar with Data Mesh architecture and Data Products Highly skilled in T-SQL with experience in performance tuning and dealing with large data volumes Extensive experience of developing end more »

Lead Data Engineer London x3-4 days per week in office Up to £95,000 Salary Bonus OVERVIEW Multi-billion-pound property company are hiring for a Data Engineering Lead/Lead Data Engineer to spearhead their Data Engineering team in London Interesting and … the whole pipeline on a breadth of impactful projects Great scope for career progression & you ll be leading and managing a small team of Data Engineers Your responsibilities as a Lead Data Engineer/Data Engineering Lead will include but not be limited to: Lead a … team of Data Engineers on a range of interesting and complex commercial projects. Extract value and insights from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … to surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry. As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data storage and more »

located in London, is in search of a highly skilled Principal Consultant. This role is ideal for a seasoned professional with extensive experience in data engineering and a passion for leading transformational projects. The firm prides itself on delivering innovative solutions that drive business success across a wide … array of industries. As a Principal Consultant, you will lead and oversee complex data engineering projects, ensuring the delivery of high-quality solutions that meet and exceed client expectations. You will utilize your expertise in ETL pipelines, AWS, and Python to guide projects from inception to completion. Additionally … a pivotal role in business development, client management, and mentoring junior consultants. Key Responsibilities: Lead the design and implementation of robust ETL pipelines and data architectures. Oversee the deployment and optimization of AWS-based data solutions. Develop advanced Python scripts for data processing and analysis. Manage client more »

Are you an expert in Sales and Lead pipelines? Do you take an analytical approach to align business goals with data? Here at Air Partner, we are seeking a Sales and Marketing Insights Analyst to join our buzzing Gatwick office. You will play a critical role in understanding our … sits within our Technology team and will see you supporting our Charter divisions. You will be reporting to the Head of Business Applications and Data whilst collaborating with various stakeholders such as the VP or Performance and Marketing Managers to achieve shared goals. You will: Develop and implement a … data strategy that cleanses and enhances our CRM data, ensuring quality control remains to a consistently high standard Optimise and own the lead processes to improve prospect conversion rate Develop and implement a lead scoring model to optimise and market to disqualified or cold leads Provide data more »

new reporting and analysis using various systems, primarily Power BI. Additionally, you'll support the MI Manager in building and overseeing the reporting and data infrastructure for the Next Customer Service Online Operations across our contact centers. What you'll be doing: Take ownership of report implementation from understanding … requirements through to development and implementation. Support project with expertise and knowledge of reporting systems advising of best practices and optimum set up of data structures. Create, analyse and then provide accurate management information/reporting and forecasting as required by the department/business on a daily/… communication skills. Preferable Experience of working with Contact Centre Metrics. Experience of change management. Experience in working with Microsoft Azure Platform eco-system ( Azure data lake , Azure data factory, Azure Synapse Analytics , Data bricks , Power BI etc) would be highly desirable. Experience in Data Engineering more »

INFOData Engineer - Tech LeadFintechLondon110,000As a Tech Lead, you will be leading and managing a greenfield implementation for a disruptive Fintech. The data platform will be used to facilitate the launch of a new product.THE COMPANY:This company has gone through a period of hyper-growth over the last … credit card space and have launched multiple successful products and are now one of the most trusted brands out there. They have several big data teams looking after their client's data for the advanced analytics team to gather insights on. They have established a robust AWS architecture … that allows the business to store and stream big data coming in from all types of sources.THE ROLE:As a Tech Lead you will be expected to be hands-on with Spark/Python, Kafka. You will be part of the design team to enhance their AWS platform, introducing more »

Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays An Elite … Working as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … Working with other incredibly passionate technologists Skills: 5 years experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »

Lead Azure Data Engineer PySpark (Python) & Synapse Tech for Good/Charity Essential skills required: Azure solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This is the chance to work for a unique organisation Our client is a not-for-profit charity that reviews/certifies companies … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. Essential skills required: Azure solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You more »

LEAD DATA ENGINEER REMOTE FIRST (UK BASED) UP TO £100,000 PERMANENT Do you have experience using cloud technologies? Are you passionate about Data Engineering and have a strong background working with public sector organisation? This role is an amazing chance to work with some experienced and … talented individuals. THE COMPANY The company is a leading consultancy company. They are looking to build out their data engineering function with an expert in cloud technologies and prior experience working with public sector organisations. THE ROLE You will be: Designing, developing, and delivering solutions and presenting ideas. … Some light line management and mentoring of junior data engineers. Working on a variety of projects including building out infrastructure, ETL work, architecture design, advancing and maintaining warehouses, etc. YOUR SKILLS AND EXPERIENCE High levels of proficiency in a cloud technology. Strong capabilities with Python, Spark, and Databricks. Experience more »