must be confident working across: Azure Data Services, including: Azure Data Factory Azure Synapse Analytics Azure Databricks Microsoft Fabric (desirable) Python and PySpark for data engineering, transformation, and automation ETL/ELT pipelines across diverse structured and unstructured data sources Data lakehouse and data warehouse architecture design Power BI for enterprise-grade reporting and visualisation Strong knowledge of data modelling More ❯
Reading, England, United Kingdom Hybrid / WFH Options
HD TECH Recruitment
initiatives Ensure high standards of documentation and data security compliance Technical Skills (desirable): Microsoft Azure Data Services (e.g., Azure Data Factory, Synapse, Databricks, Fabric) Data warehousing and lakehouse design ETL/ELT pipelines SQL, Python for data manipulation and machine learning Big Data frameworks (e.g., Hadoop, Spark) Data visualisation (e.g., Power BI) Understanding of statistical analysis and predictive modelling Experience More ❯
error handling strategies. Optional scripting skills for creating custom NiFi processors. Programming & Data Technologies: Proficiency in Java and SQL. Experience with C# and Scala is a plus. Experience with ETL tools and big data platforms. Knowledge of data modeling, replication, and query optimization. Hands-on experience with SQL and NoSQL databases is desirable. Familiarity with data warehousing solutions (e.g., Snowflake More ❯
Reading, Berkshire, United Kingdom Hybrid / WFH Options
Wireless Logic Group
Design and maintain robust data models and storage solutions mainly using but not limited to SSIS, XML, T-SQL (SSMS) & python. Design, develop, and maintain APIs Optimize performance of ETL/ELT processes and database queries. Implement monitoring and alerting for data workflows. Collaboration & Stakeholder Engagement Work closely with analysts understand data needs. Translate business requirements into technical solutions. Document More ❯
A proactive, self-starting attitude with a passion for continuous learning and improvement. Experience with geospatial data or tools; QGIS is essential, ArcGIS and FME are desirable. Familiarity with ETL processes and collaboration with data engineering teams is a strong plus. Experience working in agile teams and contributing to iterative delivery cycles. Advanced Excel skills Openness to travel (expenses covered More ❯
implementing data engineering best-practice (e.g., source-to-target mappings, coding standards, data quality, etc.), working closely with the external party who setup the environment . Create and maintain ETL processes, data mappings & transformations to orchestrate data integrations. Ensure data integrity, quality, privacy, and security across systems, in line with client and regulatory requirements. Optimize data solutions for performance and … up monitoring and data quality exception handling. Strong data modelling experience. Experience managing and developing CI/CD pipelines. Experience with Microsoft Azure products and services, and proficiency in ETL processes. Experience of working with APIs to integrate data flows between disparate cloud systems. Strong analytical and problem-solving skills, with the ability to work independently and collaboratively. The aptitude More ❯
Reading, Berkshire, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions Ltd
AWS stack and infrastructure-as-code tools to build robust data pipelines and applications that process complex datasets from multiple operational systems. Key Responsibilities: Build and maintain AWS-based ETL/ELT pipelines using S3, Glue (PySpark/Python), Lambda, Athena, Redshift, and Step Functions Develop backend applications to automate and support compliance reporting Process and validate complex data formats More ❯
Reading, Berkshire, South East, United Kingdom Hybrid / WFH Options
Bowerford Associates
team. Essential skills: Programming Languages such as Spark, Java, Python, PySpark, Scala (minimum of 2). Extensive Data Engineering hands-on experience (coding, configuration, automation, delivery, monitoring, security). ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Significant hands-on experience of HDFS/Hadoop and on-prem (coding, configuration, automation, delivery, monitoring, security). … you MUST have the Right to Work in the UK long-term without the need for Company Sponsorship. KEYWORDS Senior Data Engineer, Coding Skills, Spark, Java, Python, PySpark, Scala, ETL Tools, Azure Data Fabric (ADF), Databricks, HDFS, Hadoop, Big Data, Cloudera, Data Lakes, Azure Data, Delta Lake, Data Lake, Databricks Lakehouse, Data Analytics, SQL, Geospatial Data, FME, QGIS, PostGIS. Please More ❯
Reading, Berkshire, United Kingdom Hybrid / WFH Options
Bowerford Associates
with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data architecture, ETL pipelines, cloud technologies and big data solutions - knowledge of Hadoop and HDFS is 100% required! You MUST have also run a team to be considered for this role - it could … minimum of 2). Extensive Big Data hands-on experience across coding/configuration/automation/monitoring/security is necessary. Significant AWS or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are … as our client is NOT offering sponsorship for this role. KEYWORDS Lead Data Engineer, Senior Data Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, Cloud, On-Prem, ETL, Azure Data Fabric, ADF, Hadoop , HDFS , Azure Data, Delta Lake, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills More ❯
Employment Type: Permanent
Salary: £75000 - £80000/annum Pension, Good Holiday, Healthcare
Solutions BI Team Leader you will be supporting and developing the OBIEE suite of products within the Solution Delivery Corporate BI team. You will manage, support and enhance the ETL batch schedules and develop and maintain the ETL processes, repository, reports and user dashboards. This team is responsible for the development and support of the Corporate Oracle Business Intelligence Enterprise … comfortable presenting visual representations of data. Strong OBIEE 12c development experience and preferably detailed exposure to Oracle eBusiness Suite modules (preferably some of the key areas listed). Strong ETL/SQL development experience as well as tuning techniques. Any experience of PLSQL would be an advantage. Any experience of other Oracle reporting technologies would be advantageous, across XML/ More ❯
Job Title: Data Migration Lead Location: Havant/Thatcham/Reading Mode of working: Hybrid (3 Days/Week) Job Type: 6 Months Contract We are seeking an experienced, hands-on Data Migration Lead to oversee the data migration workstream More ❯