126 to 150 of 308 Data Pipeline Jobs in England

our client's UK-based team. The successful candidate will: -have previous experience of mentoring a team of developers - be adept at managing data pipelines, working with data exports in Business Central - possess a solid understanding of financial reporting. Key Responsibilities : Design, develop, and maintain advanced … PowerBI dashboards and reports to drive business decisions. Expertly craft DAX formulas for complex calculations and data analysis within PowerBI. Utilise SQL queries to manipulate and retrieve data efficiently from various databases. Implement and manage data pipelines to ensure seamless data flow … and integration. Work with data exports from Business Central to optimise data usage in PowerBI. Leverage Synapse Analytics to handle large volumes of data and perform big data analytics. Provide insights into financial reports including General Ledger (GL), Profit & Loss (P&L more »

since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Senior Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We pride … amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a senior data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will require more »

DATA ENGINEER – UP TO £60,000! Location : Sheffield Benefits: 25 Days + Bank Holidays! Life Assurance! Flexible Working! Company: A chance to have a positive societal impact if you launch yourself into a fast growing, but firmly established, company in the much sought after EdTech sector APPLY NOW … Responsibilities: To build and maintain scalable data pipelines To gather requirements and deliver data projects To document processes and data pipelines To maintain a backlog of future improvements/… features in Jira To build effective relationships with technical and non-technical colleagues Requirements: Should have exceptional SQL skills Should have data pipeline development experience in Python Should have experience with AWS tools including Glue & Lambda Should have an understanding of CI/CD concepts Should have more »

Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and … implement scalable and secure data pipelines that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams more »

Senior Data Engineer 💰 £80,000-£100,000 🖥️ AWS, Python, Docker 🌍 London, 3 days a week in office We are exclusively partnered with a high growth, early stage startup operating in the beauty and wellness industry (in the UK and now US!) and supporting them on their search for … a Senior Data Engineer. The role... As the company's 1st Data Engineer, you’ll be the central player in building the integrated data architecture from the ground up. You'll gather data from diverse sources, build and maintain data pipelines, ensure data quality, and automate reporting processes. Your work will support decision-making and contribute to strategic goals, making a significant impact across the company. What you'll be doing... You will gather data from various departments and tools, integrating it into a more »

Stride Recruitment are looking for skilled and motivated SAS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. Technical Background: SAS SAS Base … Azure or AWS or GCP Python/PySpark Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Additional Skills: Excellent communication and stakeholder management skills Ability to translate … complex data into actionable insights. Strong analytical and problem-solving abilities This is a great opportunity to work with an award-winning Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight more »

contributions are valued. We offer world class learning and career development opportunities, while we celebrate an inclusive culture. The role As a Lead Data Scientist (NLP & GenAI) at Allianz Commercial, you will work closely with our team of data scientists, data engineers, ML engineers … their strategic objectives. Research, design, and develop solutions using NLP models and algorithms to extract insights from unstructured text data. Collaborate closely with data engineers to pre-process and clean text data, ensuring data quality and compatibility with NLP models. Apply machine learning and … utilize LLMs, such as GPT, BERT or open source foundational LLM's (Llama2), for natural language understanding and generation tasks. Conduct thorough exploratory data analysis to gain insights into text data characteristics and develop effective pre-processing strategies. Collaborate with data engineers and MLops more »

Data Engineer Opportunity – AI for Finance Leader in London - £75,000-£85,000 Harrington Starr are currently partnered with an AI/Data leader within the Financial Services space in London. Their ground-breaking software is helping investors to achieve superhuman performance. In order to support … further growth, we are looking for a Data Engineer skilled in the following. What will you be doing? Work on a web scraping platform for one of the firm’s largest clients Develop solutions to parse and process tabular data from PDF and HTML documents Maintain … support and expand existing data pipelines using DBT, Snowflake and S3 Implement standardised data ingress/egress pipelines Onboard new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time Liaise more »

Senior Data Engineer Full Time On-Site Python SQL DataBricks Azure As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft s Azure ecosystem. This role involves leveraging Azure … s diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. What will this role look like? - Develop and maintain scalable … operational and analytical teams to solve complex business problems. - Monitor system performance, identify bottlenecks, and implement changes to improve data processing and pipeline/systems performance. - Work closely with Data Scientists within the Operational Analytics team to understand data needs and deliver solutions more »

Senior Data Engineer | Full Time | On-Site | Python | SQL | DataBricks| Azure| As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft’s Azure ecosystem. This role involves leveraging Azure … s diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. What will this role look like? - Develop and maintain scalable … operational and analytical teams to solve complex business problems. - Monitor system performance, identify bottlenecks, and implement changes to improve data processing and pipeline/systems performance. - Work closely with Data Scientists within the Operational Analytics team to understand data needs and deliver solutions more »

About: You will lead a team of data analysts, BI business process experts and BI analysts, who will benefit from your experience in coaching and your knowledge of the data and analytics domain. The Data Fabric team will ensure that your team has access … to all relevant information and their skilled data engineers will develop the data pipelines for the projects in your team. Your team can further rely on a central competence and assistance of data science and business intelligence. Do you like new challenges that test … and analysis roadmap of your team reflects their requirements. Your team will mainly be using SAS and PowerBI, in combination with data pipeline development and analysis on the Azure cloud, using Databricks. The coding language used is Python. An earlier experience with these tools and languages will more »

Data Engineer London £85,000 Harrington Starr is currently working with a leading AI-based SAAS business that is looking to hire multiple Data Engineers to help them further grow their already exciting business. Within this role, you will be responsible for Maintaining, supporting and expanding … existing data pipelines using DBT, Snowflake and S3. You will also be tasked with implementing standardised data ingress/egress pipelines coupled with onboarding new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from … must be able to work and build relationships with internal teams as you will be working with the quant teams to streamline the data to make it easier to use on the platform. You will also be working with external client to help them onboard their data more »

Lead Data Engineer Opportunity | 🌩️ Azure Cloud | 🛡️ Lloyds Insurer ✨🌟 A leading insurance business collaborates with DATAHEAD to find a talented Senior Data Engineer to join their Data Team 🚀. This is an incredible chance to work with technology and data-driven Lloyd's … offers agility and allows you to help shape its future 🌐! 🔧 You'll be joining the technology Engineering Team, focusing on designing and developing data solutions within an Azure cloud native environment 🌩️. The landscape is a greenfield setting, where a new Azure and Databricks-based platform will be … from scratch. Strong skills in Azure tooling (ADF), SQL, and Python are essential 🛠️. 🎯 Key Responsibilities: 🔹 Expertise in Azure platform architecture and developing data engineering pipelines 🌩️ 🔹 Proficiency in SQL and Python (Spark) 🐍 🔹 Provide technical assistance in data engineering, analysis, orchestrations, and enrichment 📊 🔹 Build relationships within the more »

be essential for achieving project success. Key Responsibilities: Software Development: Write high-quality, maintainable code using languages such as Python , SQL . Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines and ensure data quality. SQL and Data Interface: Develop and optimize SQL queries for data retrieval and manipulation. Work on data interfaces to connect various systems within the bank. Qualifications: Bachelor’s degree in Computer Science, Information Technology, or more »

A highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position. The Cloud Data Engineer will join alongside Data Scientists and … Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change. Your Key responsibilities will be: Engineering scalable and secure cloud data solutions for high-performance Data Science workloads and Generative AI applications Enhancing and managing the cloud-based Data Warehouse (Azure, Snowflake) Designing, building and deploying data pipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applications Providing technology thought leadership and supporting more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

Eames Consulting are looking for Data Engineering Manager to join our dynamic team at a prestigious asset management firm. As a Data Engineering Manager, you will play a crucial role in shaping and overseeing the data infrastructure that supports our business operations. Key Responsibilities … Lead and mentor a team of talented data engineers, fostering a culture of collaboration and continuous improvement. Develop and execute the data engineering strategy aligned with the organization's business objectives. Collaborate with key stakeholders to understand business requirements and translate them into data solutions. Oversee the design, development, and maintenance of robust data pipelines to ensure the timely and accurate delivery of data to various stakeholders. Manage and optimize data storage, ensuring scalability and security in compliance with industry standards. Communicate complex technical concepts to more »

of industries. Cerberus Technology Solutions (CTS) is a subsidiary of CCM that specializes in information organization, storage and analysis. The CTS teams include Data Science, Data Management and Client Engagement, which work closely together with clients to identify business opportunities and create new business value through … improved data handling and analysis. Responsibilities: Build predictive models using machine-learning techniques that generate data-driven insights on modern data platforms (Spark, Hadoop and other map-reduce tools); Develop and productionalize containerized algos for deployment in hybrid cloud environments (GCP, Azure) Connect and … blend data from various data sources within enterprise tools (python, pandas, or SQL) to enable application of Data Science methods Create metrics and analytical reports to ensure data quality and business value. Clean, structure and normalize data to eliminate redundant more »

Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The … role: Designing data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure the reliability and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and more »

Job summary We have an exciting opportunity for a Data Engineer within the Business Intelligence team. This role within the team will support existing projects and the development and implementation of new cloud-based technologies. You will support and lead on exciting and always interesting projects using your … an exciting opportunity to join a great team with opportunity to develop skills and implement new technologies as we look to develop the data platform and support national developments. You will have experience working with large datasets and experience of working with a range of data … from the armed forces community to apply for our vacancies. Main duties of the job You will be working with Senior and Lead Data Engineers in the Development team as well as colleagues across the wider Business Intelligence Team. You will provide technical advice and support and the more »

infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … peer reviews and offer technical guidance. Identify process improvements and adhere to IT policies. Essential Technical Skills: 2-3 years' experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. … Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. Agile development experience. Strong problem-solving skills. Awareness of industry trends and stakeholder interaction. Desired Experience: Familiarity with Business Objects Reporting and Power BI. more »

needs of the business, within the broader context of overall business and technology strategy. Preference will be given to candidates with experience in data and information management/strategy, and scientific solutions and services, as well as experience working on a broad range of projects. You will be … solutions architecture skills and experience Knowledge and experience of implementing large and medium scale data storage , archiving , transformation and data pipeline solutions with a focus on scientific data Knowledge and experience of various forms of data storage and processing and data … Experience working in a science organisation or with Science R&D Knowledge of TCP/IP networking, HTTP/REST, APIs and other data transfer mechanisms such as SSH, SFTP, VPN links Knowledge and experience with MS Azure solution architectures (esp. IaaS, PaaS and SaaS based solutions) Experience more »

Senior Data Engineer Location: London (2 days a week in office) Salary: £75k - £90k (DOE) About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Senior Data Engineer to join their dynamic team. The company prides itself on fostering innovation … edge technology to drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and … integration across various systems. Utilize Python for data manipulation, transformation, and automation tasks. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. Implement data pipelines and workflows to support real-time and batch data more »

Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python 3, Python data management/… manipulation libraries and usage of Python with AWS components Demonstrable experience working in the Data domain, covering the full data pipeline from ingestion, mastering, management and consumption/distribution of large datasets Financial Services expertise preferred working with Equity and Fixed Income asset classes and … a working knowledge of Indices Experience with No-SQL and Relational databases and data analysis using SQL. Enter key behaviours and skills required to be successful in the role: Education & Work experience: 7+ years of AWS and Python development engineer experience within the Financial Services and Data more »

Data Engineer Do you want to join a leading investment firm specializing in quantitative trading, driven by innovation and excellence? Keep reading! 📍 Location : London, UK As a Data Engineer , you'll build and maintain infrastructure for trading strategies, collaborating with data scientists and analysts. … Responsibilities: 📈 Data Pipelines 🔗 Data Integration 🗄️ Databases 🤝 Collaboration 🔄 Automation 🔐 Security What we would love to see from you! 🎓 Education : Master’s in CS, Engineering, Mathematics, or related field 📊 Experience : Proven Data Engineer experience, preferably in finance 💻 Skills : Python, SQL, NoSQL, big data tools more »