2 of 2 Contract Data Pipeline Jobs in Buckinghamshire

to-end testing of data ingestion, parsing, aggregation, and schema validation processes in AWS. Conduct stress testing to evaluate the performance of the entire data pipeline built on AWS. Develop and execute test plans, test cases, and test scripts to ensure data quality and integrity. Collaborate with data engineers and developers … to identify and resolve data quality issues. Monitor data quality metrics and implement improvements to enhance data reliability. Validate data transformations and ensure consistency across various data sources. Document test results and provide detailed reports on data quality findings. Required Skills and Experience: Proven experience with AWS services … such as EMR, Lambda, Redshift, Firehose, S3, Iceberg, Athena, and DynamoDB. Strong understanding of data ingestion, parsing, aggregation, and schema validation processes. Proficiency in SQL for data querying and validation. Experience with Python for scripting and automation. Familiarity with data quality tools and frameworks. Excellent analytical and problem-solving skills. Strong attention to detail More ❯

active DV Clearance will be preferred. In this role, you'll: Contribute to the design, deployment, and maintainenance of the Splunk environments, including clustered architectures, for large-scale data ingestion and analysis. Reviewing and improving Data collection and Data normalisation Continuous improvement and updating of processes and workflow requirements Working with stakeholders, IT operations … issues. We're looking for someone who can bring: A background in solving complex security challenges. Strong knowledge of SIEM tools, ideally Splunk and Sentinel An understanding of data pipelines, modelling, integrety and compliance. Hands-on experience with Python and other scripting languagues would be an added advantage Flexibility to work onsite and ad hoc travel to London More ❯