experience with the below it would be great to hear about: Knowledge of Docker and Kubernetes. Experience with workflow and orchestration tools such as Airflow, Dagster or equivalent. Experience in a Software Engineering role. Experience with NLP techniques and/or computer vision. What to expect next: Our interview more »
you will contribute in this role: Architecting, building and maintaining ML processing pipelines/workflows in Python via technologies such as Spark, serverless functions, Airflow, MLflow, or other. Implement MLOps and related DevOps focused on creating ML workflows for deploying models for large scale inference and optimisations. Build Docker … notebooks, Spark, and Docker Professional experience of designing, building and managing bespoke MLOps in cloud environments, using tools such as SageMaker Processing, SageMaker Pipelines, ApacheAirflow, and MLflow. Strong, fundamental technical expertise in cloud-native technologies, such as serverless functions, API gateway, container registry, Cloud Formation/CDK. more »
team ASAP. Capital Markets experience is a must for this. This is a hybrid role, London based and 2 days per week onsite. Python Airflow Pyspark SQL Jenkins/Docker Kubernetes AWS Please apply via the link below or email me on more »
Manchester, Lancashire, United Kingdom Hybrid / WFH Options
Confidential
successful Lead Data Engineer will have: Experience leading a Data Engineering team. Extensive working experience with GCP, SQL and DBT. Proficient in: Kafka, Dataform, Airflow, Tableau, PowerBI, Redshift, Snowflake, Terraform and BigQuery. What's in it for the successful Lead Data Engineer: Hybrid working for a better work/ more »
Bristol, Avon, South West, United Kingdom Hybrid / WFH Options
Sanderson Recruitment
helping to shape future direction and effectively communicate with both technical and non-technical stakeholders. Ideally you will be familiar with technologies such as Airflow, Talend, AWS Lambda, Redshift, S3, and analytics/visualisation platforms such as Databricks and Tableau. #dataengineering #datalead #teamlead #dataengineeringmanager #datatrasnformation #datadevelopment #python #sql #analytics more »
Southampton, Hampshire, South East, United Kingdom Hybrid / WFH Options
Datatech Analytics
cloud based analytical platforms such as Databricks, Snowflake, Google BigQuery and the like. You've built and managed data workflows before using tools like Airflow and Databricks. You are fully aware of the importance of Data Governance and good Data Quality and what best practice looks like. You're more »
Milton Keynes, Buckinghamshire, South East, United Kingdom Hybrid / WFH Options
Circle Group
control their data and processes effectively. Required Skills and Experience Technologies: Backend (Node.js, Typescript), Frontend (React.js, Typescript), Database (MySQL), and familiarity with ECS, K8s, Airflow, Kafka, Serverless, AWS. Experience: Minimum 5 years in engineering leadership roles. Expertise in handling data-heavy products and presenting actionable insights. Background in cybersecurity more »
Bristol, Avon, South West, United Kingdom Hybrid / WFH Options
Set2Recruit
proficiency GIT proficiency Linux use and admin Experience deploying cloud services (AWS is a bonus) Experience with Docker and Kubernetes Using frameworks such as AirFlow ML background - PyTorch for computer vision This is a fully remote role which comes with: Budget for WFH set up. Stock options. 25 days more »
an autonomous environment. 5 years SQL experience developing data pipelines in a cloud based database environment (e.g.BigQuery), including scheduling your own queries (e.g. using Airflow or Stitch) 3 years experience delivering data products in a modern BI technology (ideally Looker) or open source data frameworks Experience managing end-to more »
have, but they are not a deal-breaker for us: Working knowledge of Spark. Hands-on experience with some elements of our tech stack: Airflow, Databricks, Metabase, Hive, Presto, MLflow. Please note that we are looking for candidates based out of Berlin, Hamburg, London, or Athens; or willing to more »
a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »
Key technical experience: Ability to operate in a fast changing environment. Fluent in English Previous cloud based infrastructure experience, particularly with AWS. Experience using Airflow and dbt Expert SQL knowledge Solid understanding of Dimensional Data Modelling. Experience with at least one or more of these programming languages: Python, Scala …/Java Experience with distributed data and computing tools, mainly Apache Spark & Kafka Understanding of critical path approaches, how to iterate to build value, engaging with stakeholders actively at all stages. Able to deal with ambiguity and change. A self-starter who's able to work independently where necessary more »
schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving more »
Guildford, Surrey, South East, United Kingdom Hybrid / WFH Options
Allianz Insurance Plc
Location: Guildford/hybrid Salary: Dep on exp + car allowance + annual bonus + benefits Who we are Allianz is a global insurance company serving across 70 different countries, but from the very first day you join our team more »
