4 of 4 Contract Data Pipeline Jobs in the Midlands

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to … in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new … warehousing. * Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. * Can make data pipeline design recommendations based on business requirements. * Experience with data migration is a plus. * Open to new ways of working and new technologies. More ❯

About the role Reporting into the Data Systems Manager, the Data Systems Executive is a key position within the Operations arm of the Moorepay marketing team. The role will work with key stakeholders within the wider Data Operations team to enable and maintain the … Moorepay Data Platform' (MDP). This includes managing data quality as well as administration and maintenance of the ETL Engine and the Data Lakehouse, enabling the business to build value-adding data products at scale to support core business objectives. In particular … literate with strong data language expertise - SQL and Python primarily - for data manipulation and end-to-end data pipeline management Familiar with data-as-code methodology, specifically around version control and documentation/change controls Knowledge of working within GDPR and More ❯

Engineer 6 month Northampton - hybrid £450 per day inside ir35 - Umbrella only Job Description: 7+ years of experienced in designing, building, and maintaining data pipelines and architectures on the Amazon Web Services (AWS) cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS … services like S3, Redshift, EMR, Glue, and Kinesis. This involves designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Key Skills: AWS Services: Strong understanding and experience with AWS services like S3 , Redshift, EMR, Glue , Kinesis, and Lambda. … Programming Languages: Proficiency in programming languages like Python or Java, used for designing and building data pipelines. SQL: Knowledge of SQL for querying and manipulating data in relational databases. ETL Processes: Experience with ETL tools and techniques. Cloud Computing: Familiarity with cloud computing concepts and principles. More ❯

and Xray Have deep knowledge on event driven systems using frameworks like Active MQ, Kafka, AWS Kinesis Have a working experience of AWS data pipelines, Glue, S3 and Glacier storage, file transfer solutions like Data Sync. If you are interested in this position and would like More ❯