machine learning or more general statistical analysis Strong software development skills with proficiency in Python or C++ Experience with analytics frameworks such as Pandas, Apache Spark, Dask, or Flink Experience with machine learning frameworks such as TensorFlow, JAX, PyTorch, Spark MLlib, Keras, or scikit-learn Experience in cloud-based … infrastructures such as AWS or GCP Exposure to orchestration platforms such as ApacheAirflow or Kubeflow Proven attention to detail, critical thinking, and the ability to work independently within a cross-functional team What benefits do we offer ? Cond Nast Learning Hub where you ll find you ll more »
or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed. Modern tech stack - Python, AWS, Airflow and DBT Must haves: A team player, happy to work with several teams, this is key as you will be reporting directly to the more »
Manchester Area, United Kingdom Hybrid / WFH Options
Forsyth Barnes
data warehousing. Multiple years of experience with GCP, especially with core processing and orchestration products like BigQuery, DataFlow, DataFusion, DataStream, Cloud Functions, DataProc, and Airflow/Composer. Strong problem-solving skills and a meticulous approach to code reviews. Proven leadership qualities with the ability to uphold high standards within more »
Bristol City Centre, Bristol, United Kingdom Hybrid / WFH Options
Artis Recruitment
working within an agile methodology. * Proficiency in SQL and Python, with knowledge of data warehousing and big data frameworks. * Familiarity with technologies such as Airflow, Talend, AWS services, and visualization platforms like Databricks and Tableau. * Experience with testing, versioning, and documentation tools. * A bachelor's or master's degree more »
experience with the below it would be great to hear about: Knowledge of Docker and Kubernetes. Experience with workflow and orchestration tools such as Airflow, Dagster or equivalent. Experience in a Software Engineering role. Experience with NLP techniques and/or computer vision. What to expect next: Our interview more »
you will contribute in this role: Architecting, building and maintaining ML processing pipelines/workflows in Python via technologies such as Spark, serverless functions, Airflow, MLflow, or other. Implement MLOps and related DevOps focused on creating ML workflows for deploying models for large scale inference and optimisations. Build Docker … notebooks, Spark, and Docker Professional experience of designing, building and managing bespoke MLOps in cloud environments, using tools such as SageMaker Processing, SageMaker Pipelines, ApacheAirflow, and MLflow. Strong, fundamental technical expertise in cloud-native technologies, such as serverless functions, API gateway, container registry, Cloud Formation/CDK. more »
testing, and maintenance of data pipelines and data storage systems on Google Cloud Platform (GCP). You will be working with technologies such as ApacheAirflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics more »
Manchester, Lancashire, United Kingdom Hybrid / WFH Options
Confidential
successful Lead Data Engineer will have: Experience leading a Data Engineering team. Extensive working experience with GCP, SQL and DBT. Proficient in: Kafka, Dataform, Airflow, Tableau, PowerBI, Redshift, Snowflake, Terraform and BigQuery. What's in it for the successful Lead Data Engineer: Hybrid working for a better work/ more »
Bristol, Avon, South West, United Kingdom Hybrid / WFH Options
Sanderson Recruitment
helping to shape future direction and effectively communicate with both technical and non-technical stakeholders. Ideally you will be familiar with technologies such as Airflow, Talend, AWS Lambda, Redshift, S3, and analytics/visualisation platforms such as Databricks and Tableau. #dataengineering #datalead #teamlead #dataengineeringmanager #datatrasnformation #datadevelopment #python #sql #analytics more »
Bristol, Avon, South West, United Kingdom Hybrid / WFH Options
Set2Recruit
proficiency GIT proficiency Linux use and admin Experience deploying cloud services (AWS is a bonus) Experience with Docker and Kubernetes Using frameworks such as AirFlow ML background - PyTorch for computer vision This is a fully remote role which comes with: Budget for WFH set up. Stock options. 25 days more »
Cheltenham, England, United Kingdom Hybrid / WFH Options
Atreides
both hardware and software, with experience from cloud infrastructures to physical systems, ideally with exposure to CCNA certification. Experience with orchestration like Dagster, Prefect, Airflow or Temporal Excellent problem-solving skills and the ability to think quickly in a high-performance environment. The ability to effectively communicate technical concepts more »
Greater London, England, United Kingdom Hybrid / WFH Options
Cera
an autonomous environment. 5+ years SQL experience developing data pipelines in a cloud based database environment (e.g.BigQuery), including scheduling your own queries (e.g. using Airflow or Stitch) 3+ years experience delivering data products in a modern BI technology (ideally Looker) or open source data frameworks Experience managing end-to more »
have, but they are not a deal-breaker for us: Working knowledge of Spark. Hands-on experience with some elements of our tech stack: Airflow, Databricks, Metabase, Hive, Presto, MLflow. Please note that we are looking for candidates based out of Berlin, Hamburg, London, or Athens; or willing to more »
a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »
City Of London, England, United Kingdom Hybrid / WFH Options
Cititec Talent
a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »
schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving more »
financial services or energy trading industry Expertise in Python and its ecosystem of libraries and frameworks for data processing, data analysis and data visualisation Airflow, detailed understanding of architecture including schedulers, executers, operators Cloud Environments, understanding of principles, technologies and services for AWS/Azure Kubernetes EKS/AKS … including high availability Desired experience: Worked with Python 3.9+ Familiar with Python test automation Experience with SQL and Timeseries databases Familiar with Parquet, Arrow, Airflow, Databricks Experience with cloud AWS services, such as S3, EC2, RDS etc Quality engineering best practice and tooling including TDD, BDD This is an more »
Guildford, Surrey, South East, United Kingdom Hybrid / WFH Options
Allianz Insurance Plc
Location: Guildford/hybrid Salary: Dep on exp + car allowance + annual bonus + benefits Who we are Allianz is a global insurance company serving across 70 different countries, but from the very first day you join our team more »
London, England, United Kingdom Hybrid / WFH Options
Harnham
Machine Learning Engineer up to £95 000 London NEW Machine Learning Engineer Opportunity Available with a Leading Organisation! The Company: Are you an expert in Machine Learning? We are on the lookout for a Machine Learning Engineer to join an more »
London, England, United Kingdom Hybrid / WFH Options
Harnham
Lead Machine Learning Engineer up to £105 000 London NEW Machine Learning Engineer Opportunity Available with a Leading Organisation! The Company: Are you an expert in Machine Learning? We are on the lookout for a Machine Learning Engineer to join more »