8 of 8 Apache Spark Jobs in the East of England

design, implement, and optimize enterprise-scale data platforms using the Databricks Lakehouse Platform . The ideal candidate will have deep expertise in Databricks architecture, Apache Spark, Delta Lake, data engineering, cloud platforms, and enterprise data solutions. Key Responsibilities Design and architect Databricks Lakehouse solutions for large-scaleenterprise data … Databricks implementation, including architecture, development, deployment, and optimization. Define Databricks workspace architecture, clusterstrategies, security models, and operational standards. Design and developscalable data pipelinesusing Databricks, Apache Spark, PySpark, SQL, andDelta Lake . Implement data ingestionframeworks supporting batchand real-timedata processing. Design Delta Lake architectures including: Delta tables Medallion architecture ...

Life Sciences value chain. Core Architecture: Expertise in Data Modernization, Microservices, Cloud Architecture, and Lakehouse patterns. Data & AI: Deep hands-on proficiency in Databricks (Spark, PySpark, DLT), GenAI (Agent Core, Copilot Studio, Amazon Bedrock), and Graph Databases (Neo4j). Cloud & Tools: Strong command of AWS (Lambda, Glue, EMR, MWAA ...

scripting language — Python is required.Proficiency in at least one object-oriented language.Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto.Experience with AWS, GCP, or Looker (advantageous but not essential).Solid background in data modelling, including the design, implementation and optimisation of conceptual ...

Python along with proficiency in SQLExperience building data platforms on cloud services like Databricks on Azure or GCP BigQuery and big data technologies like Spark, Flink etc.,Solid grasp of Kubernetes, CI/CD and TerraformWorking knowledge of ETL and ELT frameworks and orchestration tools like Airflow and dbtAbility … Python along with proficiency in SQLExperience building data platforms on cloud services like Databricks on Azure or GCP BigQuery and big data technologies like Spark, Flink etc.,Solid grasp of Kubernetes, CI/CD and TerraformWorking knowledge of ETL and ELT frameworks and orchestration tools like Airflow and dbtAbility ...

spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together diverse perspectives … needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking ...

experience with programming languages like Python or Java along with proficiency in SQLExperience working with cloud platforms (e.g., Azure) and big data technologies like Spark, Flink etc.,Solid grasp of Kubernetes, CI/CD and TerraformWorking knowledge of ETL and ELT frameworks and orchestration tools like AirflowHiring, developing … experience with programming languages like Python or Java along with proficiency in SQLExperience working with cloud platforms (e.g., Azure) and big data technologies like Spark, Flink etc.,Solid grasp of Kubernetes, CI/CD and TerraformWorking knowledge of ETL and ELT frameworks and orchestration tools like AirflowHiring, developing ...

core component of the role is applying, modifying and designing algorithms and mathematical models to solve business problems using big data architectures (Hadoop, Spark, Cloud). In this role, your primary modelling focus will be neural network-based forecasting, with a strong emphasis on rigorous evaluation against robust baselines … core component of the role is applying, modifying and designing algorithms and mathematical models to solve business problems using big data architectures (Hadoop, Spark, Cloud). In this role, your primary modelling focus will be neural network-based forecasting, with a strong emphasis on rigorous evaluation against robust baselines ...

engineering role spanning modelling, large-scale training, and production infrastructure — you’ll take models from idea through to serving at scale, working in Spark, Python, and Java. You’ll work closely with Praveen and the wider Ad Performance ML team. Based in the UK (Manchester-anchored).How will … ship ML models for ad relevance and bid/yield optimizationBuild and maintain production ML infrastructure for real-time, low-latency servingWork across Spark, Python, and Java to move models from research to productionApply sound feature engineering, validation, and evaluation practices throughout the modelling lifecycleDiagnose production ML issues such ...