1 to 25 of 122 Apache Jobs

experience in Provide file-based storage: Provide NFS exports and SMB file shares to specific systems and users. Hands on experience in Apache HTTPD web service: Configure Apache HTTPD to provide Transport Layer Security (TLS)-enabled websites and virtual hosts. Hands on experience in Execute shell scripting ...

experience in Provide file-based storage: Provide NFS exports and SMB file shares to specific systems and users. Hands on experience in Apache HTTPD web service: Configure Apache HTTPD to provide Transport Layer Security (TLS)-enabled websites and virtual hosts. Hands on experience in Execute shell scripting ...

design, scalability, and clean coding practices. Familiarity with application monitoring solutions Data Engineering 5+ years building scalable and reliable data pipelines using Databricks and Apache Spark. We need both. Experience with cloud data warehouse/data lake architectures and tooling. Experience building solutions using cloud providers, preferably Azure ...

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop, maintain ...

data engineering roles Strong experience working with Snowflake and Oracle Solid engineering background in Java and/or Python Hands-on experience with Apache Spark (Java or Scala) Experience with AWS , including EMR and other core services Exposure to Docker and Kubernetes (EKS) Proven experience building scalable ETL pipelines ...

experience in cloud-based data services. Proficiency in SQL and Python for data manipulation and transformation. Experience with modern data engineering tools, including Apache Spark, Kafka, and Airflow. Strong understanding of data modelling, schema design, and data warehousing concepts. Familiarity with data governance, privacy, and compliance frameworks (e.g., GDPR ...

PostgreSQL, MySQL) Strong knowledge of data warehouse, data lake, and lakehouse architectures Experience with ETL/ELT frameworks and orchestration tools (e.g. Informatica, Talend, Apache Airflow) Proven experience establishing and maintaining data governance frameworks Strong understanding of data security, access controls, and compliance requirements Excellent problem-solving, communication ...

Oracle, SQL Server, PostgreSQL, MySQL). Knowledge of data warehouse and lakehouse architectures. Familiarity with ETL/ELT and orchestration tools (e.g., Informatica, Talend, Apache Airflow). Experience establishing and maintaining data governance frameworks. Experience complying with data security requirements. Experience designing data models. Excellent problem-solving, communication ...

development is highly desirable. Experience in high‐growth or smaller technology environments. Nice‐to‐haves Snowflake experience. Experience with dbt, Fivetran, AWS Glue, or Apache Iceberg. Prior leadership or mentoring experience (team lead/tech lead). What They Offer The opportunity to influence architecture, tooling, and engineering standards ...

platform, features, and best practices with Strong understanding of data modeling principles and techniques A solid understanding of big data technologies such as Apache Spark, and knowledge of Hadoop ecosystems. Knowledge of programming languages such as Python, R, or Java is beneficial. Knowledge of ETL/ELT processes (such ...

Data Factory) and modern data warehouse technologies (Databricks, Snowflake) Experience with database technologies such as RDBMS (SQL Server, Oracle) or NoSQL (MongoDB) Knowledge in Apache technologies such as Spark, Kafka and Airflow to build scalable and efficient data pipelines Ability to design, build, and deploy data solutions that explore ...

Knowledge of machine learning frameworks (e.g., PySpark, PyTorch) and model deployment tools (e.g., MLflow, TensorFlow Serving). Strong experience with data processing frameworks (e.g., Apache Spark, Flink). Expertise in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra). Hands-on experience with cloud platforms (e.g. ...

modern data warehouses Strong data modelling and architectural capability Background scaling data platforms in high-growth environments Nice to have Snowflake or Apache Iceberg Infrastructure-as-Code (Terraform) Observability-driven data systems Package & Benefits Salary up to £120,000 Fully remote working Home-office setup Private healthcare and income ...

using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort keys ...

Demonstrable experience in Microsoft Azure and Microsoft Fabric (e.g. Data Factory, Azure SQL). Experience of BI tools and Data processing frameworks such as Apache Spark - preferably using Python (PySpark) or Scala. Experience working within cloud environments. Although Azure is preferred, AWS and GCP are also valuable. Knowledge ...

pipelines Proficiency with at least one cloud platform: Amazon Web Services (AWS) Microsoft Azure (Azure) Google Cloud Platform (GCP) Experience with orchestration tools (e.g., Apache Airflow) Experience with version control (e.g., Git) Solid understanding of data warehousing concepts and dimensional modeling To apply for this role please submit your ...

Infra tooling using Terraform, Ansible and Jenkins whilst automating everything with Python Tech (experience in any listed is advantageous) Python Cloud: AWS Lake house: Apache Spark or AWS Glue Cloud Native storage: Iceberg, RDS, RedShift, Kafka IaC: Terraform, Ansible CI/CD: Jenkins, Gitlab Other platforms such as Databricks ...

/CD pipelines (e.g. Azure DevOps) Excellent communication skills and the ability to engage confidently with senior and executive stakeholders Desirable Experience Agentic AI, Apache Spark, or enterprise architecture frameworks Enterprise data integration and Microsoft BI technologies Experience with AWS or GCP and additional CI/CD tooling (e.g. ...

/CD pipelines (e.g. Azure DevOps) Excellent communication skills and the ability to engage confidently with senior and executive stakeholders Desirable Experience Agentic AI, Apache Spark, or enterprise architecture frameworks Enterprise data integration and Microsoft BI technologies Experience with AWS or GCP and additional CI/CD tooling (e.g. ...

Oracle, SQL Server, PostgreSQL, MySQL). Knowledge of data warehouse and lakehouse architectures Familiarity with ETL/ELT and orchestration tools (e.g., Informatica, Talend, Apache Airflow). Experience in establishing and maintaining data governance frameworks Experience complying with data security requirements. Experience designing data models. Excellent problem-solving, communication ...

tooling Good scripting skills (Python/SQL/Bash) Strong understanding of AWS security, IAM, and networking Comfortable operating in Agile, delivery-led environments Apache Airflow for DAG Date-Led Platform/Cloud Engineering Key requirements: Active SC Clearance (essential) Permanent role Ideally you will be based around Manchester ...

Linux systems administration and performance optimisation experience p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Hands-on with Python orchestration frameworks (Dagster, Apache Airflow) Cloud & Infrastructure : p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Serverless AWS experience (Lambda, Step Functions, Athena, Glue ...

managing open source projects on GitHub/GitLab. Strong understanding of Git and version control systems. Knowledge of open source licenses (MIT, GPL, Apache). Familiarity with cloud platforms (AWS or Azure). Skills: Ability to write clear technical documentation. Strong debugging, problem-solving, and performance optimisation skills. Excellent ...

locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . ...

applications and high proficiency in SQL (query tuning, complex joins) Hands-on experience designing and deploying ETL/ELT pipelines using Google Cloud Dataflow (Apache Beam) or similar tools Proficiency in data architecture, data modeling, and scalable storage design Solid engineering practices: Git and CI/CD for data ...