51 to 75 of 198 Data Pipeline Jobs in the UK excluding London

Data Engineer | Yorkshire | up to £45,000 basic | Flexible Working A regular feature in the "UK's Top 10 places to work", my client is an award-winning business with a reputable brand and is widely respected for investing in their employees, placing importance on personal development and … career progression. The Environment you'll be joining: You'll be joining a friendly 10+ Data Engineering team as the business undergoes a complete greenfield re-architecture from the ground up in Microsoft Azure. The Tech you'll be playing with: Azure Data Factory Azure Databricks … PySpark SQL DBT What you need to bring: 1-3 year's experience in building Data Pipelines SQL experience in data warehousing Python experience would be desirable Experience in Azure/GCP/AWS is a bonus Why join? Joining an award-winning business comes with more »

in the resolution of complex user requests and ensuring a minimum of the agreed service level agreements. Maintain confidentiality in accordance with our data protection policies and procedures. Delivering to service quality KPI's that underpin the management of Masteks services Demonstrate knowledge of the specific technologies necessary … software applications, systems, and networks. Knowledge of programming languages Java, JVM, DynamoDB, AWS IAM, CloudWatch, PagerDuty, Tooling TypeScript, Node.js, SRE, AWS Data Pipeline & Visualisation and scripting is a plus. Excellent problem-solving skills with the ability to analyse complex scenarios. Outstanding communication skills, both written and verbal more »

Power Bi skills some Azure knoweldge would be ideal or other cloud technology and DevOps pipelines experience Our client is looking for a Data Engineer who is technically minded who will have the opportunity to have a broad and varied workload of interesting data enginees, covering … JSON Maintain a rigorous and scalable CI/CD process across multiple DevOps projects Maintain and develop Azure Modules to maturise our automated data pipelines and analyses This is a great opportunity to join a technology focused Insurance firm and a great way to break into the Insurance more »

Develop and implement data-driven solutions using machine learning, statistical analysis, and data visualization techniques. * Design, build, and maintain data pipelines and ETL processes to collect, process, and analyze large datasets. * Collaborate with cross-functional teams to understand business requirements and translate them into … technical solutions. * Perform data exploration and analysis to uncover insights and inform decision-making. * Create and deploy predictive models and algorithms to solve complex business problems. * Optimize and tune machine learning models for performance and scalability. * Develop and maintain documentation for data science processes, models, and … code. * Stay up-to-date with the latest trends and advancements in data science and machine learning. Hybrid working. 2 days per week at either: Glasgow, Knutsford, or Northampton LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Job DescriptionAre you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future!With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that … to surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry.As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data more »

Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … insights from the Data Engineering work to contribute towards the Data Science/Analytics.Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics)Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline.Preferably someone who is capable of ‘wearing many hats’ and getting hands on in other areas across the Data Engineering pipeline if necessary!Experience leading team of Data Engineers/Scientists.Min. Bachelors’ degree in STEM subject (ideally from UK university).THE BENEFITSCompetitive SalaryDiscretionary more »

Data Engineer to join our growing team. You will be responsible for expanding and optimizing our data, data pipeline architecture and optimizing data flow across functional teams. The Data Engineer will work with our software developers, database architects, data analysts and data scientists on data initiatives. Responsibilities for Data Engineer: Configuring Azure Event Hubs Writing Azure Function Apps in C# Creating data pipelines in Azure Data Factory Creating PowerBI reports and visualisations Analysing analytics business requirements to … determine the data models and data flows required to deliver new dashboards and reports Creating Solution Design documents for analytics solutions Documenting Architectural Decisions that are relevant for analytics solutions Designing Extract-Transform-Load processes Required Technical and Professional Expertise Development of complex PowerBI reports from more »

Data Engineer to join our growing team. You will be responsible for expanding and optimizing our data, data pipeline architecture and optimizing data flow across functional teams. The Data Engineer will work with our software developers, database architects, data analysts and data scientists on data initiatives. Responsibilities for Data Engineer: Configuring Azure Event Hubs Writing Azure Function Apps in C# Creating data pipelines in Azure Data Factory Creating PowerBI reports and visualisations Analysing analytics business requirements to … determine the data models and data flows required to deliver new dashboards and reports Creating Solution Design documents for analytics solutions Documenting Architectural Decisions that are relevant for analytics solutions Designing Extract-Transform-Load processes Required Technical and Professional Expertise Development of complex PowerBI reports from more »

management firm that utilizes long-short equities, long-only, fixed income and commodities futures strategies across its funds seek to add a experienced Data Engineer Risk Developer. They have deep expertise in trading, technology and operations and attribute their success to rigorous scientific research. As a technology and … data - driven firm, they design and build their own cutting - edge systems, from high- performance trading platforms to large- scale data analysis and compute farms. The group manages the lifecycle of data used by investment for trading, backtesting and research. Working with quants and … role (strong understanding of data engineering principles and best practices)experience in database technologies (PostgreSQL, SQL), and query optimizationwith data pipeline development and automation.coding skills (mainly with Python)knowledge (understanding of risk concepts such as VaR calculations) and good understanding of statistics with version control more »

Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with … business activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the … integrity, and dependability of the data. Improve the scalability, efficiency, and cost-effectiveness of data pipelines. Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data. Key Requirements Good understanding and competency in technologies currently used (and available in the marketplace more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

Job DescriptionLead Data Engineer:We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experience Job description:Building new data pipelines and optimizing data flows using the Azure cloud stack.Building data products … from scratch.Support Business Analysts and Data Architects with discovery and best practices.Self-directed and comfortable supporting the data needs of multiple teams, systems and products.What’s required ?Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.Experience building and … optimizing ‘big data' data pipelines, architectures and data sets using Py-spark.Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.Strong analytic skills related to working with unstructured datasets.Build processes supporting data transformation, data more »

Job DescriptionStott and May has partnered with a global healthcare organisation within the private sector, to source a senior data engineer to join their growing tech team. Hybrid (3/4 days per month in London or Manchester) Salary: Circa £80k p/annum Key Responsibilities:Lead the … consolidation and migration of legacy data to our new cloud-based data platform.Design and implement master and transactional data models to ensure data integrity and consistency.Develop ETL pipelines and cloud data storage solutions that meet business requirements and non-functional … needs.Collaborate closely with data analysts, visualization engineers, and project managers to deliver data solutions.Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models.What we are looking for: Proficiency with Databricks and building data pipelines on more »

Job DescriptionJob Title: Data Operations AnalystCompany: Global Asset ManagerLocation: City of London, 3 days per week in officeSalary: £85,000 per annum + BenefitsAbout the Company:Join a prestigious global asset manager with over $200 billion in assets under management. Our firm is renowned for its innovative approach … excellence. Based in the heart of London's financial district, you'll be part of a dynamic team shaping the future of financial data operations.Role Overview:As a Data Operations Analyst, you will play a pivotal role in implementing a cutting-edge global platform aimed at … centralizing data management processes. Leveraging your expertise in R, Python, SQL, and Enterprise Data Management (EDM), you'll contribute to streamlining data workflows and optimizing data quality across the organization.Key Responsibilities:Collaborate with cross-functional teams to understand data requirements more »

have the financial capital and expertise to grow their capabilities and reach, with a real emphasis on building out a truly world class data function.The roleAs a Senior Analytics Engineer, you contribute to the development, enhancement, and maintenance of scalable and resilient data pipelines, reports, and … dashboards, as part of the businesses ongoing analytics evolution. You will also play an essential role in executing the data strategy and roadmap, leading the delivery of one or more key analytics projects, and working closely with and mentoring junior team members.What you'll be doing...You will contribute … enhancement, and maintenance of data models and ELT processes within a data mesh architecture using Python for data pipeline development and automation, following best practices with dbt and Snowflake.You will play a pivotal role in the delivery of key analytics projects, ensuring they more »

Job DescriptionSenior Data Engineer - Investment Firm - London - Up to £150k base + bonusAbout Us:We are working with a prominent investment firm based in London, renowned for their innovative approach and commitment to delivering exceptional results for our clients. As part of our continuous growth and evolution, we … are seeking a talented Senior Data Engineer to join our dynamic team.Role Overview:As a Senior Data Engineer, you will play a pivotal role in managing and optimising our data infrastructure, ensuring the reliability, security, and efficiency of our data processes. You … will work closely with various teams to design, implement, and maintain robust data pipelines, leveraging cutting-edge technologies to drive insights and inform strategic decisions.Key Responsibilities:Develop and maintain data pipelines for security and index data, sourced from Bloomberg, Reuters, and other relevant providers.Utilise more »

Job DescriptionAbout Tredence­: -Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve … methodology; think strategically and execute methodicallyDevelop and manage capacity and growth projection forecasts of the environment within budgetsCreate and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirementsDrive optimization, testing and tooling to improve quality of … Skills:8+ years of relevant experienceAt least two years of experience building and leading highly complex, technical engineering teams.Strong hands-on experience in Data bricksExperience managing distributed teams preferred.Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills more »

Job DescriptionSenior Data Engineer- Fast growing SaaS Scale up 🚀West Midlands- hybrid working Up to £86K base with bonus and benefitsThe clientSaaS Software business platform which is revolutionising financial management for their customers.Responsibility:Working to ensure a high-quality data platform.Design, develop, test, and deploy data pipelines and integrations using IPaaS technologyCollaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystemWillingness and an enthusiastic attitude to work within existing processes/methodologies.Collaborate with the DevOps team to provide high … availability data solutions that scale geographically.Big data processing - Expertise in processing enterprise-scale volumes of data, ideally with proficiency in Snowflake. ExperienceData Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores.Data Orchestration - Enterprise scale usage of more »

Job DescriptionJob Title: Data EngineerJob Type: PermanentLocation: London or Fully remoteSalary: £50,000-£70,000 (Dependant on experience) + Bonus + BenefitsSkills: Python, SQL, Posgress SQL, Snowflake, PowershellRoc Search`s client provides real-time decisions and active risk monitoring to enable their customers to maximize profitability while managing … risk. their solutions are continually adapting to changing market conditions. They 20+ years of retail data science expertise and experience. They work with a global base of leading commerce partners, representing a big proportion of all US omnichannel retail sales activity across hundreds of thousands of retail locations … collective intelligence to operations, finance, marketing, and loss prevention. Their performance-improvement solutions yield measurable results with significant return on investment.About the roleThe Data Engineer will be part of a team that follows DataOps best practices and owns the standardized data assets and the processes around more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »