Senior Data & AI Engineer
Senior Data & AI Engineer
Up to £90,000 - London/Hybrid
An exciting opportunity has arisen for a Senior Data & AI Engineer to join an innovative technology business looking to expand its data engineering and AI capabilities.
The company is investing in the development of intelligent, data-driven applications and is looking for an engineer who can help turn its technical vision into reality.
This is a hands-on position offering the opportunity to work across the full data engineering lifecycle, from designing cloud-based infrastructure and developing complex data pipelines through to building APIs and integrating AI capabilities into live products.
You will work alongside software engineers, product specialists and senior stakeholders, taking ownership of key technical projects and helping determine how data is used, accessed and delivered across the business.
Unlike a traditional data engineering position focused purely on backend infrastructure, this role offers exposure to the wider product development lifecycle, with opportunities to experiment with emerging AI technologies and develop solutions that have a direct impact on customers.
Key Responsibilities
- Building and evolving cloud-based data platforms to support new and existing applications.
- Developing robust data pipelines to process information from multiple internal and external sources.
- Designing efficient data models and structures to support complex analytical and operational requirements.
- Developing APIs and integrations to connect data platforms with software applications and external systems.
- Exploring the use of LLMs and generative AI to introduce new functionality into existing products.
- Building solutions involving intelligent search, automated information processing and AI-driven recommendations.
- Establishing engineering standards around testing, deployment, monitoring and data quality.
- Taking technical ownership of projects and supporting the development of less experienced engineers.
Skills & Experience
- Strong commercial experience in data engineering within cloud-based environments.
- Advanced Python and SQL development skills.
- Hands-on experience with Azure Databricks, Apache Spark and PySpark.
- Good understanding of Delta Lake, lakehouse architecture and modern data modelling.
- Experience building and managing production data pipelines, including batch and streaming processes.
- Knowledge of Azure services, including ADLS Gen2, Azure Key Vault and Azure DevOps.
- Experience developing APIs, integrations and data services.
- Exposure to generative AI, LLMs and AI development frameworks.
- Familiarity with RAG, vector search, embeddings or other approaches to building AI-enabled applications.
What's On Offer?
- Salary of up to £90,000
- Opportunity to work with modern cloud and AI technologies.
- Significant technical ownership and autonomy.
- Exposure to a broad range of engineering and product development projects.
- Opportunity to influence architecture and introduce new technologies.
- A varied role combining data engineering, software development and AI.
- Scope to mentor others and take on greater technical responsibility as the team grows.
If you're an experienced Data Engineer looking for something beyond traditional data platform development, this is a great opportunity to work across modern data engineering and AI, building technology that delivers real-world value.