and reporting on IWS scheduling objects. Analysis and solution design experience. An example from previous work would be an advantage. Knowledge and experience of ETL concepts. (Specific tools not an issue.) Good programming skills in Javascript & Python. Other languages would be an advantage. SQL/Xquery experience, specific DB not more »
Spark Architect/SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Skills more »
knowledge of Azure cloud technologies and Terraform IaC Experience with API design, RESTful APIs, and other integration protocols. Knowledge of data integration patterns andETL processes is important for effectively moving and transforming data between different systems. Senior Backend Engineer - 1/2 days a month - Up to more »
modelling, CMDB data architecture. Understanding and exposure of cloud services. Knowledge of OSS/BSS sub-domains - Ordering, workflows, orchestration, fulfilment, Fault, Performance management, ETL etc. Extensive experience in industry standard BSS and OSS platforms (such as ServiceNow) If you feel this is the position you are looking for, please more »
building a zero-down time low latency infrastructure Shaping the technical landscape with modern web technologies Scaling and optimizing some of the most performant ETL pipelines on the planet Conducting R&D for functional programming within the firm Building out a DevOps environment from scratch in a Software Engineering Capacity more »
to experience level and will find good fits for the best people Strong experience with Python or Rust Experience with Airflow Exposure to building ETL pipelines is a huge plus A desire to learn Rust Solid SQL knowledge Fantastic education Experience working in mission critical environments where speed, reliability andmore »
like Databricks/Spark, Airflow, Snowflake, etc. Expertise designing and developing with distributed data processing platforms like Databricks/Spark. Experience using ELT/ETL tools such as DBT, FiveTran, etc. Understanding of Agile Delivery best practice Good knowledge of the relevant technologies e.g. SQL, Oracle, PostgreSQL, Python, ETL pipelines more »
Basingstoke, England, United Kingdom Hybrid / WFH Options
Blatchford
and business intelligence (BI) systems. Re-engineering manual data flows to enable scaling and repeatable use. Supporting the build of data streaming systems. Writing ETL/ELT scripts and code to make sure the process performs optimally. Developing data models to support self-service business intelligence reporting that can be … in Python and experience with PySpark Experience using: CI/CD, Microsoft Azure, and Azure Dev Ops in an agile environment. Knowledge of Azure ETL services, i.e. Data Factory, Synapse etc. Knowledge and understanding of REST API standards. Proficient in writing clean, readable, and secure code for Azure backend services more »
Birmingham, England, United Kingdom Hybrid / WFH Options
Captiv8 Resources
technologies, including the Esri ArcGIS platform * Strong experience with integrating GIS solutions with other applications * Strong integration experience including Web services, API’s andETL process and FME * Development experience * Experience working in Utilities or regulated environments * Experience supporting and enhancing engineering, field operational, asset management, dispatch, workforce management, Control more »
data with Redshift, Oracle, NoSQL etc. experience • Experience with data visualization using Tableau, Quicksight, or similar tools • Experience with data modeling, warehousing and building ETL pipelines • Experience in Statistical Analysis packages such as R, SAS and Matlab As a BIE, you will own partnering with data engineering and software engineering … the highest standards of analytical rigor and data integrity. • Develop domain expertise and drive major contributions to our data and research roadmap. Leverage SQL, ETL, Redshift, and other available tools to uncover deep business insights, trends, and opportunities to innovate on behalf our customers. • Partner with data engineering to build … data with Redshift, Oracle, NoSQL etc. experience • Experience with data visualization using Tableau, Quicksight, or similar tools • Experience with data modeling, warehousing and building ETL pipelines • Experience in Statistical Analysis packages such as R, SAS and Matlab • Experience using SQL to pull data from a database or data warehouse andmore »
suite within Power BI, focusing on the end-to-end process of data to provide strategic insight Please apply if you have: Extract, transform, andload data from various sources into Power BI Develop and maintain comprehensive Power BI dashboards to support business needs Create interactive visualisations and reports that more »
power of their data, ensuring robust and scalable solutions that meet business needs. You will work with a talented team, utilizing your skills in ETL processes, AWS, and Python to deliver high-quality data engineering projects. Key Responsibilities: Design and develop ETL pipelines to support data integration and transformation. Implement … or Master’s degree in Computer Science, Engineering, or a related field. 5+ years of experience in data engineering, with a strong background in ETL processes. Proficiency in AWS services, including but not limited to S3, Redshift, Lambda, and Glue. Strong programming skills in Python. Experience with data modeling, database more »
and other relevant technologies. Data Integration and Management: Integrate various data sources and ensure smooth data flow across systems. Implement ETL processes to transformandload data into data warehouses or data lakes. Manage and maintain data storage solutions, ensuring high availability and performance. Security and Compliance: Ensure data solutions … degree preferred. Technical Expertise: Proven experience with AWS data services including S3, Redshift, RDS, Glue, Lambda, Kinesis, and Athena. Strong understanding of data modeling, ETL processes, and data warehousing. Proficiency in SQL and experience with database management systems. Familiarity with data integration tools and techniques. Experience: Minimum of 5 years more »
departments and tools, integrating it into a central data lake or warehouse. You will design and construct data pipelines to automate data flow, involving ETL processes as needed. You will implement systems to monitor and ensure data quality, making it clean, consistent, and usable. You will develop processes for automatic … work closely with business owners. What they are looking for... Technical expertise with Python, SQL and Cloud services, ideally AWS. Proficiency with data modelling, ETL tools and Docker. A startup mentality, with a track record of building projects from scratch (e.g. as personal projects, or at work) and a pragmatic more »
Jenkins, GitLab CI, or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data warehouses, and operational databases. Provide technical leadership … depth knowledge of AWS data services, including but not limited to S3, RDS, Redshift, DynamoDB, Glue, Athena, Lambda, EMR. Proficiency in designing and implementing ETL processes, data pipelines, and data integration workflows. Strong understanding of data modelling, database design, and data warehousing concepts. Experience with data lake architectures and big more »
oversee complex data engineering projects, ensuring the delivery of high-quality solutions that meet and exceed client expectations. You will utilize your expertise in ETL pipelines, AWS, and Python to guide projects from inception to completion. Additionally, you will play a pivotal role in business development, client management, and mentoring … junior consultants. Key Responsibilities: Lead the design and implementation of robust ETL pipelines and data architectures. Oversee the deployment and optimization of AWS-based data solutions. Develop advanced Python scripts for data processing and analysis. Manage client relationships, ensuring clear communication and satisfaction. Provide strategic guidance and technical expertise to … s or Master’s degree in Computer Science, Engineering, or a related field. 10+ years of experience in data engineering, with a focus on ETL processes. Deep expertise in AWS services such as S3, Redshift, Lambda, and Glue. Advanced programming skills in Python. Proven track record of leading successful data more »
in a hybrid technical environment, including Linux, Windows, Java, .NET, SQL, NoSQL, and Cloud Na tive.Knowledge and experience with DDD, API Design, Microservices, SOA, ETL, TDD, and related patterns and pract ices.Understand principles and technologies for successful delivery of integrated products and services, including multi-tenant SaaS products, analytics, data … warehouses, cloud-native systems, distributed systems, databases, ETL/ELT processes, legacy systems, on-prem/off-prem deployments, mobile and IoT data feeds, and customer/B2B integrat ions. Required for this role Proven experience as a Technical or Integrations Engineer, or a similar role with a successful track more »
Lead Data Engineer A brand new and exciting opportunity has recently arisen for a Lead Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and CRM Implementations to join one of the UK's Largest Charity based in London. As the Lead Data Engineer you will … UK Charity who are working on exciting projects and modernising their data function. If you are currently an Lead Data Engineer with experience in ETL, Azure, Managing/Mentoring and keen to work for a large Not for Profit then this is the perfect opportunity for you! Skills that are … required for a Lead Data Engineer are: Experience in Azure (ADF and Datalake) Experience working with ETL pipelines Previous experience Managing or Mentoring Engineers CRM Implementation experience Lead Data Engineer/Senior Data Engineer/AzureData Engineer/Azure/ETL/Salesforce/Azure Data Factory Salary more »
EPR system structures. Collaborate with data analysts, developers, and subject matter experts to validate data mappings and transformations. Oversee data extraction, transformation, and loading (ETL) processes. Qualifications: Minimum of 5 years of experience in data migration, data management, or related roles. Proven track record of managing large-scale data migration … or EPR systems. Strong project management skills with experience using project management tools (e.g., MS Project, JIRA). Proficiency in data migration tools andETL processes. Excellent analytical, problem-solving, and critical-thinking abilities. Strong communication and interpersonal skills. Knowledge of healthcare data standards (e.g., HL7, FHIR) and regulatory requirements. more »
Sittingbourne, South East, United Kingdom Hybrid / WFH Options
Southern Housing
Sittingbourne, Farringdon or Croydon hybrid working, minimum of 2 days in the office Are you a skilled Lead Database & ETL Developer looking for an exciting opportunity? Our Technology team at Southern Housing is searching for someone who can expertly manage data across our technology estate, optimising and developing source data more »
Power BI Developer (Powe Apps, Data Warehouse, Modelling, ETL) Hybrid - London (Travel to other sites) £50,000 - £60,000 + 5% performance related bonus + 4% pension contribution + Company benefits Are you a Power BI Developer looking to contribute to a thriving establishment where you will be given the … Data Warehouse and modelling Experience of Dax Experience of premium capacity management Experience of Power Apps Key words: Power BI, DAX, Data Warehouse, Modelling, ETL, SQL Developer, Hybrid jobs, remote jobs Reference: BBBH13882 If you're interested in this role, click 'apply now' to forward an up-to-date copy more »
March 2025 Location: Leeds 20% Home 80% IR35: In scope The purpose of the Business Intelligence Analyst post is to: Create and support ETL processes that provide a stable, trusted source of data for all reporting and data requirements Create and maintain business intelligence (BI) reports and dashboards using available … Experience of complex data analysis using advanced knowledge of statistics, database design and BI systems tools Understand basic concepts of BI Architecture such as ETL, Data Warehousing and Data Modelling Ability to manipulate, model and analyse data using Excel, SQL, QlikView, Qlik Sense Experience developing reports using data visualisation tools more »
Databricks best practices. - Maintain data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, andETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and migration to production. - Serve more »
JIRA, strong knowledge of Python for automation, and expertise in test strategy, test management, and defect management. Additionally, familiarity with SQL, Big Data (Hadoop), ETL, and basic understanding of AWS is desirable. Responsibilities: Configure and manage JIRA projects, dashboards, defects, and test cases. Develop and maintain in-house Python scripts … with Python scripting. Strong understanding of test management and defect tracking. Knowledge of SQL for querying and reporting. Familiarity with Big Data (Hadoop) andETL processes. Basic understanding of AWS services. If you are interested, apply here more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Viqu Limited
Bundles (DAB's) for streamlining the development of complex data and analytics for the Databricks platform. (IaC) Strong understanding of data warehousing concepts andETL processes. Excellent problem-solving skills and attention to detail. Ability to work independently in a remote setup with minimal supervision. Role details: Job role: Databricks more »