1 to 25 of 170 Apache Jobs in the UK excluding London

however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Excellent Python and SQL skills Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please get in touch with ARC IT Recruitment today. ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

development experience with Terraform or CloudFormation. Understanding of ML development workflow and knowledge of when and how to use dedicated hardware. Significant experience with Apache Spark or any other distributed data programming frameworks (e.g. Flink, Hadoop, Beam) Familiarity with Databricks as a data and AI platform or the Lakehouse ...

development experience with Terraform or CloudFormation. Understanding of ML development workflow and knowledge of when and how to use dedicated hardware. Significant experience with Apache Spark or any other distributed data programming frameworks (e.g. Flink, Hadoop, Beam) Familiarity with Databricks as a data and AI platform or the Lakehouse ...

software development experience with Python and experience with modern software development and release engineering practices (e.g. TDD, CI/CD). • Experience with Apache Spark or any other distributed data programming frameworks. • Comfortable writing efficient SQL and debugging on cloud warehouses like Databricks SQL or Snowflake. • Experience with cloud ...

software development experience with Python and experience with modern software development and release engineering practices (e.g. TDD, CI/CD). • Experience with Apache Spark or any other distributed data programming frameworks. • Comfortable writing efficient SQL and debugging on cloud warehouses like Databricks SQL or Snowflake. • Experience with cloud ...

software development experience with Python and experience with modern software development and release engineering practices (e.g. TDD, CI/CD). • Experience with Apache Spark or any other distributed data programming frameworks. • Comfortable writing efficient SQL and debugging on cloud warehouses like Databricks SQL or Snowflake. • Experience with cloud ...

code Proficiency in programming languages such as Python, Spark, SQL Strong experience with SQL databases Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF) Experience with cloud platforms (Azure preferred) and related data services Excellent problem-solving skills and attention to detail Inclusive and curious, continuously ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

Knowledge of machine learning frameworks (e.g., PySpark, PyTorch) and model deployment tools (e.g., MLflow, TensorFlow Serving). Strong experience with data processing frameworks (e.g., Apache Spark, Flink). Expertise in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra). Hands-on experience with cloud platforms (e.g. ...

Oracle databases. Extensive experience coding in Python. Understanding of ETL processes and data pipeline design. Familiar with data lakes and their architecture. Experience with Apache Airflow (MWAA) for workflow management. Experience with AWS Athena/PySpark (Glue) for data querying and processing. Proficient in SQL with experience in both ...

Oracle databases. Extensive experience coding in Python. Understanding of ETL processes and data pipeline design. Familiar with data lakes and their architecture. Experience with Apache Airflow (MWAA) for workflow management. Experience with AWS Athena/PySpark (Glue) for data querying and processing. Proficient in SQL with experience in both ...

Oracle databases. Extensive experience coding in Python. Understanding of ETL processes and data pipeline design. Familiar with data lakes and their architecture. Experience with Apache Airflow (MWAA) for workflow management. Experience with AWS Athena/PySpark (Glue) for data querying and processing. Proficient in SQL with experience in both ...

NumPy, Flask, Streamlit, SHAP, Lime, PyIceberg, Matplotlib, Seaborn, Plotly) SQL, Graph stores (e.g. Neo4J) Containers (e.g. Docker) Data bases/Data Lakes (e.g. PostgreSQL, Apache Iceberg, Databricks, Azure Fabric etc.) AWS (CDK/Python, Bedrock, Sagemaker) or similar cloud toolset experience ...

NumPy, Flask, Streamlit, SHAP, Lime, PyIceberg, Matplotlib, Seaborn, Plotly) SQL, Graph stores (e.g. Neo4J) Containers (e.g. Docker) Data bases/Data Lakes (e.g. PostgreSQL, Apache Iceberg, Databricks, Azure Fabric etc.) AWS (CDK/Python, Bedrock, Sagemaker) or similar cloud toolset experience ...

program supports beginners transitioning into the data domain. Key Responsibilities Learn to design and build data pipelines using tools such as Python, SQL, and Apache Airflow Assist in collecting, transforming, and loading (ETL) data from multiple sources Support data warehousing solutions using platforms like BigQuery, Snowflake, Redshift, or Azure ...

architectures. Hands‐on experience with Microsoft Fabric (Data Engineering, Data Science and Real‐Time Analytics) and Azure ML , including MLflow. Strong proficiency with Apache Spark, Azure Data Factory, Git, Python and SQL Experience developing, training and deploying machine learning models using TensorFlow, PyTorch or Scikit‐learn. Solid understanding ...

architectures. Hands‐on experience with Microsoft Fabric (Data Engineering, Data Science and Real‐Time Analytics) and Azure ML, including MLflow. Strong proficiency with Apache Spark, Azure Data Factory, Git, Python and SQL Experience developing, training and deploying machine learning models using TensorFlow, PyTorch or Scikit‐learn. Solid understanding ...

architectures. Hands‐on experience with Microsoft Fabric (Data Engineering, Data Science and Real‐Time Analytics) and Azure ML, including MLflow. Strong proficiency with Apache Spark, Azure Data Factory, Git, Python and SQL Experience developing, training and deploying machine learning models using TensorFlow, PyTorch or Scikit‐learn. Solid understanding ...

able to guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop. Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create data ...