226 to 250 of 507 Apache Spark Jobs in England

modern data lake/lakehouse architectures Strong grasp of cloud data platforms (AWS, Azure, GCP, Snowflake) Understanding of Data Mesh , Data Fabric , and data product-centric approaches Familiarity with Apache Spark , Python , and ETL/ELT pipelines Strong knowledge of data governance, lifecycle management, and compliance (e.g. GDPR) Consulting experience delivering custom data solutions across sectors Excellent leadership More ❯

companies. Our platform unifies data, analytics, and AI, enabling organizations to democratize data access and insights. Headquartered in San Francisco, Databricks was founded by the creators of Lakehouse, Apache Spark, Delta Lake, and MLflow. To learn more, follow us on Twitter, LinkedIn, and Facebook. Benefits We offer comprehensive benefits tailored to regional needs. For details, visit our benefits More ❯

5+ years of experience in developing Java systems. Proven track record of leading a team and delivering projects with a commercial mindset. Prior experience with Event Sourcing (Kafka, Akka, Spark) and Data Distribution based architecture Experience with NoSQL (Mongo, Elastic, Hadoop), in memory (MEMSQL, Ignite) and relational (Sybase, DB2, SybaseIQ) data store solutions. Strong knowledge of data structures, algorithms … driven performance analysis and optimizations. Strong communication skills and the ability to work in a team. Strong analytical and problem-solving skills. PREFERRED QUALIFICATIONS Experience with Kubernetes deployment architectures Apache NiFi experience Experience building trading controls within an investment bank ABOUT GOLDMAN SACHS At Goldman Sachs, we commit our people, capital and ideas to help our clients, shareholders and More ❯

Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details More ❯

in generative AI. - Understanding of ethical AI principles, bias mitigation techniques, and responsible AI practices. - Experience with cloud computing platforms (e.g., AWS, GCP, Azure) and distributed computing frameworks (e.g., Apache Spark, Dask). - Strong problem-solving, analytical, and critical thinking skills. - Strong communication, collaboration, and leadership skills. Our inclusive culture empowers Amazonians to deliver the best results for More ❯

its native tech stack in designing and building data & AI solutions Experience with data modeling, ETL processes, and data warehousing Knowledge of big data tools and frameworks such as Spark, Hadoop, or Kafka More ❯

modelling, machine-learning, clustering and classification techniques, and algorithms Fluency in a programming language (Python, C,C++, Java, SQL) Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau More ❯

engineers on the team to elevate technology and consistently apply best practices. Qualifications for Software Engineer Hands-on experience working with technologies like Hadoop, Hive, Pig, Oozie, Map Reduce, Spark, Sqoop, Kafka, Flume, etc. Strong DevOps focus and experience building and deploying infrastructure with cloud deployment technologies like Ansible, Chef, Puppet, etc. Experience with test-driven development and automated More ❯

also have: Hands-on architecture and implementation experience with Microsoft Fabric (preferred), along with familiarity with Azure Synapse and Databricks. Experience in core data platform technologies and methods including Spark, Delta Lake, Medallion Architecture, pipelines, etc. Experience leading medium to large-scale cloud data platform implementations, guiding teams through technical challenges and ensuring alignment with best practices. Expertise in … bronze, silver, gold layers). Strong knowledge of CI/CD practices for data pipelines, ensuring automated, repeatable, and scalable deployments. Familiarity with open-source data tools such as Spark, and an understanding of how they complement cloud data platforms. Experience creating and maintaining structured technical roadmaps, ensuring successful delivery and future scalability of data solutions. A track record More ❯

also have: Hands-on architecture and implementation experience with Microsoft Fabric (preferred), along with familiarity with Azure Synapse and Databricks. Experience in core data platform technologies and methods including Spark, Delta Lake, Medallion Architecture, pipelines, etc. Experience leading medium to large-scale cloud data platform implementations, guiding teams through technical challenges and ensuring alignment with best practices. Expertise in … bronze, silver, gold layers). Strong knowledge of CI/CD practices for data pipelines, ensuring automated, repeatable, and scalable deployments. Familiarity with open-source data tools such as Spark, and an understanding of how they complement cloud data platforms. Experience creating and maintaining structured technical roadmaps, ensuring successful delivery and future scalability of data solutions. A track record More ❯

and data designers within an Agile framework Build knowledge of all data resources within ND and prototype new data sources internally and externally Skills and Experience Essential Proficiency in Spark (SQL and/or Scala), Kafka Strong analytical and problem-solving skills applied to data solutions Proficiency with traditional SQL database technologies Experience integrating data from multiple sources Experience More ❯

containerization (Docker, Kubernetes) and CI/CD pipelines. Excellent communication skills and a passion for mentoring and team leadership. Nice to Have Experience with data engineering tools (Airflow, Kafka, Spark). Knowledge of MLOps practices and tools (MLflow, Kubeflow). Contributions to open-source projects or AI research. Why Join? Work on impactful AI products used by global clients. More ❯

Partner with cross-functional teams to deliver robust data solutions 💡 What You’ll Bring Strong hands-on experience building streaming data platforms Deep understanding of tools like Kafka , Flink , Spark Streaming , etc. Proficiency in Python , Java , or Scala Cloud experience with AWS , GCP , or Azure Familiarity with orchestration tools like Airflow , Kubernetes Collaborative, solutions-focused mindset and a willingness More ❯

Partner with cross-functional teams to deliver robust data solutions 💡 What You’ll Bring Strong hands-on experience building streaming data platforms Deep understanding of tools like Kafka , Flink , Spark Streaming , etc. Proficiency in Python , Java , or Scala Cloud experience with AWS , GCP , or Azure Familiarity with orchestration tools like Airflow , Kubernetes Collaborative, solutions-focused mindset and a willingness More ❯

Partner with cross-functional teams to deliver robust data solutions What You’ll Bring Strong hands-on experience building streaming data platforms Deep understanding of tools like Kafka , Flink , Spark Streaming , etc. Proficiency in Python , Java , or Scala Cloud experience with AWS , GCP , or Azure Familiarity with orchestration tools like Airflow , Kubernetes Collaborative, solutions-focused mindset and a willingness More ❯

predictive modelling, machine learning, clustering and classification techniques. Fluency in a programming language (Python, C, C++, Java, SQL). Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau). More ❯

predictive modelling, machine learning, clustering and classification techniques. Fluency in a programming language (Python, C, C++, Java, SQL). Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau). More ❯

lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau, Looker, etc.). Strong scripting and Linux/cloud environment familiarity. Desirable: Exposure to big data tools (Spark, Hadoop, MapReduce). Experience with microservice-based data APIs. AWS certifications (Solutions Architect or Big Data Specialty). Knowledge of machine learning or advanced analytics. Interested? This is a More ❯

. Proficiency in working with large datasets, data wrangling, and data preprocessing. Experience in data science, statistical modelling, and data analytics techniques. Experience with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, GCP, Azure) is desirable. MSc or PhD in Computer Science, Data Science, Artificial Intelligence, or related field is preferred. More ❯

members. Advanced knowledge of machine learning algorithms and general statistical methodologies and theory. Advanced knowledge of AB testing and design of experiment. Advanced Python and SQL skills, experience using Spark for processing large datasets. Understanding of software product development processes and governance, including CI/CD processes and release and change management. Familiarity with cloud computing platforms, ideally experience More ❯

as Java, TypeScript, Python, and Go Web libraries and frameworks such as React and Angular Designing, building, and maintaining CI/CD pipelines Big data technologies like NiFi, Hadoop, Spark Cloud and containerization technologies such as AWS, OpenShift, Kubernetes, Docker DevOps methodologies, including infrastructure as code and GitOps Database technologies, e.g., relational databases, Elasticsearch, MongoDB Why join Gemba? Gemba More ❯

Java, TypeScript, Python, and Go Web libraries and frameworks such as React and Angular Designing, building, and maintaining CI/CD pipelines Big data technologies, such as NiFi, Hadoop, Spark Cloud and containerization technologies such as AWS, OpenShift, Kubernetes, Docker DevOps methodologies, such as infrastructure as code and GitOps Database technologies, e.g. relational databases, Elasticsearch, Mongo Why join Gemba More ❯

weekly or monthly visits to the Basingstoke office, depending on location. In addition, it would be advantageous to the candidate to have experience with the following technologies: Experience with Spark (AWS Glue) Snowflake Native Applications or AWS Marketplace solutions. Experience using Trusted Execution Environments (TEEs) Kafka Automated cloud infrastructure provisioning Basic understanding of encryption protocols We are committed to More ❯

recommender systems, personalization, and A/B testing. Strong machine learning and statistical knowledge. Preferred Qualifications: Proficient with Machine learning frameworks such as Tensorflow, PyTorch, MLlib. Experience with Databricks, Spark, Tecton, Kubernetes, Helm, Jenkins. Familiarity with standard methodologies in large-scale DL training/Inference. Experience with reducing model serving latency, memory footprint. Experience in cloud-based environments, such More ❯

within an international team of scientists and engineers, all based in Tokyo, Japan. We are a team that thrives on growth, both personal and professional. Engage in academic collaborations, spark innovation in hackathons, and expand your horizons with conference visits. A day in the life The BIE is accountable for: - Architecting and implementing scalable BI frameworks and automated reporting More ❯