23 of 23 Apache Jobs in the West Midlands

warehouses (BigQuery preferred, or Snowflake/Redshift). Strong experience with orchestration tools (Airflow, Dagster), ELT pipelines (Fivetran, dbt), and distributed data processing frameworks (Apache Spark, Flink). Hands-on experience using AI tools to accelerate engineering workflows - code generation, code review, pipeline debugging, or documentation Strong coding experience ...

knowledge of optimisation techniques for large-scale data processing Strong proficiency in SQL and Python for handling complex data problems Hands-on experience with Apache Spark (PySpark or Spark SQL) Experience with the Azure data stack Knowledge of workflow orchestration tools like Azure Data Factory or Apache Airflow … cost optimisation strategies for cloud data platforms Experience with data quality frameworks and implementation Experience with data visualisation tools like Power BI or Apache Superset Experience with other cloud data platforms like AWS, GCP or Oracle Experience with modern unified data platforms like Databricks or Microsoft Fabric Experience with ...

data science team Experiment in your domain to improve precision, recall, or cost savings Requirements Expert skills in Java or Python Experience with Apache Spark or PySpark Experience writing software for the cloud (AWS or GCP) Speaking and writing in English enables you to take part ...

data Experience with data visualization tools to create dashboards and reports Understanding of data engineering concepts (ETL, data pipelines) and automation tools such as Apache Airflow Familiarity with cloud based computing resources such as AWS Interviewing with Veeva We value your time and believe in a transparent hiring process. ...

data Experience with data visualization tools to create dashboards and reports Understanding of data engineering concepts (ETL, data pipelines) and automation tools such as Apache Airflow Familiarity with cloud based computing resources such as AWS Interviewing with Veeva We value your time and believe in a transparent hiring process. ...

platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker and Kubernetes. Experience using Git/GitHub and working within collaborative development ...

. Good understanding of cloud environments (ideally Azure), distributed computing and scaling workflows and pipelines Understanding of common data transformation and storage formats, e.g. Apache Parquet. Awareness of data standards such as GA4GH ( ) and FAIR (). Experience with Spark, Databricks, data lakes. Follow best practices like code reviews, clean ...

have skills: RabbitMQ Java/Microservices MongoDB/MySQL Kubernetes Grafana/Prometheus Gitlab Job Scheduling tooling (eg Berlin/JS7 Job Scheduler, TWS, Apache Airflow). Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: Experience with databases/data platforms ...

have skills: RabbitMQ Java/Microservices MongoDB/MySQL Kubernetes Grafana/Prometheus Gitlab Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: Experience with databases/data platforms ...

have skills: * RabbitMQ * Java/Microservices * MongoDB/MySQL * Kubernetes * Grafana/Prometheus * Gitlab * Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). * Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: * Experience with databases/data platforms ...

platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience working within Agile delivery teams. Competitive base salary from £74,000 per annum Generous Pension Scheme We invest ...

should have specialist experience in one or more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure … develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory.* Azure Data Engineer Associate and Databricks Certified ...

MySQL, PostgreSQL, MongoDB) Experience with software delivery and CI/CD Experience with software service metrics and monitoring tools such as Grafana, Plausible and Apache Superset. Familiarity with Linux server administration and networking Experience directly interacting with end users, replying professionally to queries and questions Enthusiasm for growing ...

with cloud‐based data warehouses (e.g., Snowflake, GBQ). Familiarity with cloud‐based data pipeline services (e.g. AWS Glue) or distributed processing frameworks like Apache Spark. Equal Opportunity Employment Goldman Sachs is an equal opportunity employer and does not discriminate on the basis of race, colour, religion, sex, national ...

Feature engineering. Exposure to common data analysis and ML technologies such as on scikit-learn, pandas, NumPy, XGBoost, LightGBM. Exposure to tools like Apache Oozie, Apache Airflow. £70,000 - £105,000 a year Why you ll love it here: We want to make Prima a happy and empowering ...

with APIs and integrating multiple data sources. Confidence working with legacy systems and non‐modernised environments. Knowledge of web scraping techniques. Experience with Tableau, Apache, or digital analytics tools is beneficial but not essential. BENEFITS The successful Data Engineer will receive the following benefits: Salary between ...

etc.) Exposure to Angular, AlpineJS, Bootstrap Database tools: Toad, DBeaver, SQL Developer IDEs: VS Code, Eclipse, etc. Typescript TLS, PKI - certs etc. Keyfactor, Sectigo. Apache config Containers (Docker, Podman, etc) Testing tools: Selenium, JUnit Data formats: XML, JSON, YAML AWS, Azure, Cloud etc. Login Authentication (SSO, MFA) CI/ ...

behaving as expected. Manage, monitor and improve our production AWS and Linux infrastructure. Run and maintain the services our platform depends on, including nginx, Apache, Redis, OpenSearch/Elasticsearch and relational databases. Maintain and improve our infrastructure as code, configuration management and CI/CD environment using Terraform, Ansible ...

Mockito Experience with clean architecture, DI, modular design Comfortable owning CI/CD, code quality, observability Familiarity with Docker, Maven, Jenkins ⭐ Nice to Have Apache Calcite Starburst or federated query engines JVM performance tuning High-throughput service interfaces (REST/gRPC) Data governance or policy enforcement layers 👥 This Role ...

with machine learning engineers on model development and deployment Desirable : Direct experience with elements of our technology stack (Azure IoT Edge, Azure Storage, dbt , Apache Iceberg, Trino, Dagster , Dask ) Experience with IoT data processing or edge computing environments Familiarity with time-series data and acoustic signal processing What ...

with machine learning engineers on model development and deployment Desirable : Direct experience with elements of our technology stack (Azure IoT Edge, Azure Storage, dbt , Apache Iceberg, Trino, Dagster , Dask ) Experience with IoT data processing or edge computing environments Familiarity with time-series data and acoustic signal processing What ...

trainingof new members of the data engineering team. Requirements Knowledge: A demonstrablenetworking background – experience in system administration. Knowledge of big datatechnologies and ecosystems (e.g. Apache NiFi). Knowledge of currentmarket and emerging tools in data analytical and SIEM platforms. Knowledgeof network security implementations (e.g., IDS, IPS, EDR), including theirfunction ...

will: Manage, monitor and improve our production AWS and Linux infrastructure. Run and maintain the services our platform depends on, including nginx, Apache, Redis, OpenSearch/Elasticsearch and relational databases. Maintain and improve our infrastructure as code, configuration management and CI/CD environment using Terraform, Ansible and Bitbucket … comfortable working independently, making sound decisions under pressure and knowing when to involve others. Experience across our wider technology stack, including nginx, Apache, Redis, MariaDB/RDS/Postgres, OpenSearch/Elasticsearch, Terraform and CDN/WAF technologies will be important, although we're equally interested in your underlying ...