10 of 10 Apache Spark Jobs in the East of England

Automated system deployment using tools such as Ansible, Puppet or Chef Desirable Skills/Experience Familiar with the Big Data tech stacks, including: Trino Spark Apache Hive Apache Airflow Zeppelin notebooks Our Package Tailored benefits make a real difference. That’s why we offer a comprehensive range ...

prem environments. Hard Skills Experience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. Data Platform Capabilities ...

able to offer visa sponsorship for this role at present Desirable (Nice to Have) Experience with streaming and big‐data tooling – Apache Kafka, Spark, or Flink Experience with MLOps platforms – MLflow, Kubeflow, Vertex AI, SageMaker, or Weights & Biases Experience evaluating and optimising RAG systems at scale (retrieval quality ...

Analytics, Artificial Intelligence or a related field, or equivalent experience, would be effective, although practical experience is equally valuable. “Nice to Have” Azure, Databricks, Apache Spark or comparable cloud and data platforms. Data pipelines, ETL and workflow‐orchestration technologies. Machine‐learning methods such as forecasting, prediction or classification. ...

Analytics, Artificial Intelligence or a related field, or equivalent experience, would be effective, although practical experience is equally valuable."Nice to Have"Azure, Databricks, Apache Spark or comparable cloud and data platforms. Data pipelines, ETL and workflow-orchestration technologies. Machine-learning methods such as forecasting, prediction or classification. ...

Private cloud platforms (HPE Private AI, Nvidia AI Enterprise, Dell AI Factories) Understanding of data engineering practices (ETL, data lakes, big data tools like Spark). Knowledge of designing scalable, distributed systems. Familiarity with model lifecycle management and MLOps practices. Ability to align AI initiatives with business outcomes ...

Experience supporting the Intelligence Community or Department of Defense environments Experience with Python and working with databases Experience with big data frameworks such as Spark, PySpark, or Elastic Search Experience with data visualization platforms such as Kibana, Foundry Workshop, or Palantir Knowledge of secure coding practices and development ...

mindset and openness to learning from others Nice to have: Hands on orchestration skills and experience using Terraform Experience with big data tools (e.g. Spark, AWS Glue, or similar) Strong grasp of code review best practices Cloud Migration/AWS knowledge Understanding/experience working with orchestration and data ...

leadership teams. Minimum Qualifications Masters in Statistics, Mathematics, Data Science, Machine Learning, Physics, Engineering, Computer Science or equivalent Proficiency in data querying using SQL, Spark, or equivalent technologies Proficiency in scripting languages for data processing and analysis (ex: Python, R, or Scala) Excellent communication and multi-functional collaboration skills ...

such as Pipeline Builder or AIP, or similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS … such as Pipeline Builder or AIP, or similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS ...