Ecosystem: Experience with logging/monitoring Exposure to data governance, cataloguing, and lineage tools Ability to work with a range of structured, semi-structured and unstructured file formats including Parquet, json, csv, xml, pdf, jpg. Tools and methods to develop comprehensive data reliability and active metadata solutions. Ability to work with and develop APIs (including data transformations). Ability More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Crimson
Lake, Spark SQL, and best practices for Databricks development, optimization, and deployment. Program in SQL, Python, R, YAML, and JavaScript. Integrate data from multiple sources and formats (CSV, JSON, Parquet, Delta) for downstream analytics, dashboards, and reporting. Apply Azure Purview for governance and quality checks. Monitor pipelines, resolve issues, and enhance data quality processes. Work closely with engineers, data More ❯
data warehousing (e.g. Hadoop, Spark, Redshift, Snowflake, GCP BigQuery) Expertise in building data architectures that support batch and streaming paradigms Experience with standards such as JSON, XML, YAML, Avro, Parquet Strong communication skills Open to learning new technologies, methodologies, and skills As the successful Data Engineering Manager you will be responsible for: Building and maintaining data pipelines Identifying and More ❯
london, south east england, united kingdom Hybrid/Remote Options
YLD
Scalable system design patterns, load balancing, and high-availability architectures Database design and Data modelling (both relational and NoSQL) Understanding of common data transformation and storage formats, e.g. ApacheParquet API development (REST, GraphQL, gRPC) and event-driven architectures Caching strategies and message queue systems (Redis, Kafka, RabbitMQ) Cloud platforms (AWS, Azure, GCP) with containerisation (Docker, Kubernetes) CI/ More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Additional Resources Ltd
Kubernetes, Docker, and cloud-native data ecosystems. Demonstrable experience with Infrastructure as Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. ApacheParquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring More ❯
Actions, Jenkins, or AWS CodePipeline). Proven ability to secure and scale production systems. Monitoring and observability tools (CloudWatch, Grafana, OpenTelemetry). Familiar with data exchange formats (JSON, YAML, Parquet) and API design. Leadership & Delivery 4–8 years in software development and/or DevOps , including 2+ in a management or team lead role. Experience in defence, aerospace, or More ❯
technologies (e.g. S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.) and knowledge of their associated trade-offs. Experience with multiple data formats and serialization systems (e.g. Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.) Experience managing data pipeline orchestration systems (e.g. Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.) Proven experience in managing the operational aspects of More ❯
oxford district, south east england, united kingdom
Ellison Institute of Technology
needs of the platform tools. Collaborate with product managers to capture requirements, wireframe solutions, and design the user experience. Work with big data technologies such as Kafka, Iceberg, and Parquet, and managed database technologies such as PostgreSQL and Oracle vector databases. Ensure applications are secure. Operate, monitor, and maintain the associated Oracle Cloud infrastructure to ensure the platform tools More ❯
oxford district, south east england, united kingdom
Ellison Institute of Technology
meet the needs of platform tools. Work with product managers to capture requirements, wireframe solutions, and design user experiences. Work with big data technologies such as Kafka, Iceberg, and Parquet, and managed database technologies including PostgreSQL and Oracle vector databases. Ensure applications are secure. Operate, monitor, and maintain associated Oracle Cloud infrastructure to ensure platform tools are highly available More ❯
Analyse and reconcile data, with a strong focus on SQL and Postgres JSON/JSONB functions. Perform testing activities across ETL processes and data validation tasks. Validate JSON and Parquet data, ensuring accuracy and adherence to schema standards. Use Postman for API testing and PowerShell to support automation. Contribute to continuous improvement within the Test and Validation team. Skills More ❯
financial services or consulting Strong knowledge of relational and dimensional design (3NF, star, snowflake) Proficient in ERWin, Sparx, or similar tools Experience working with semi-structured data (JSON, XML, Parquet) Excellent communication and client-facing skills More ❯
liverpool, north west england, united kingdom Hybrid/Remote Options
Intuita - Vacancies
All our office locations considered: Newbury & Liverpool (UK); Šibenik, Croatia (considered) We're on the hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems More ❯
role Prior experience developing data quality control processes to detect data gaps or inaccuracies is a plus Familiarity with compressed/optimized file formats for data storage such as Parquet and HDF5 Prior experience providing technical guidance to junior data analysts Prior experience mapping security identifier data or working with a security master database would be beneficial Prior experience More ❯
this is preferred. Back End: Node/Python – Node is used for application back end whereas Python is used for Data, APIs, Workflows etc. Database – Postgres/DuckDB/Parquet Public cloud experience Please note: As they scale the business and build out their engineering function, they are looking for people to be onsite regularly to bring the team More ❯
Bristol, Avon, England, United Kingdom Hybrid/Remote Options
Tank Recruitment
on experience with Azure cloud technologies: Synapse, Fabric, AzureML, ADX, ADF, Azure Data Lake Storage, Event Hubs. Experience with visualisation tools such as Power BI and Streamlit. Familiarity with Parquet and Delta Parquet formats. Strong data modelling and architecture knowledge across SQL and NoSQL databases. Understanding of the software development lifecycle and ML-Ops. Knowledge of advanced statistical More ❯
Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone’s chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We More ❯
Welwyn Garden City, Hertfordshire, England, United Kingdom
Pontoon
Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We More ❯