Apache Spark Jobs in England

126 to 137 of 137 Apache Spark Jobs in England

Data lake engineer

Cheshire East, England, United Kingdom
Wipro
in a technical and analytical role Experience of Data Lake/Hadoop platform implementation Hands-on experience in implementation and performance tuning Hadoop/Spark implementations Experience Apache Hadoop and the Hadoop ecosystem Experience with one or more relevant tools (Sqoop, Flume, Kafka, Oozie, Hue, Zookeeper, Hcatalog, Solr … Avro) Experience with one or more SQL-on-Hadoop technology (Hive, Impala, Spark SQL, Presto) Experience developing software code in one or more programming languages (Java, Python, etc.) Preferred Qualifications Masters or PhD in Computer Science, Physics, Engineering or Math Hands on experience leading large-scale global data warehousing more »
Posted:

AWS Data Engineer

London Area, United Kingdom
Stack Digital
test cases. Assist in backlog grooming. Key Skills/Experience: Extensive experience in developing Big Data pipelines in the cloud using technologies such as Apache Spark. Expertise in performing complex data transformations using Spark SQL queries. Experience orchestrating data pipelines using Apache Airflow. Proficiency in Git-based more »
Posted:

Senior Data Analyst

Leeds, England, United Kingdom
Protect Group
within an e-commerce or online business context. Commercially minded, thinking about ways to increase revenue & profitability. Proficiency in data manipulation tools (Python, Pandas, Spark, SQL) and data visualization tools (Apache Superset, Tableau, Power BI, ggplot2) and MS Excel. Grasp of pricing strategies, market dynamics, and consumer behaviour more »
Posted:

Senior Data Scientist

London Area, United Kingdom
Hybrid / WFH Options
Venn Group
improvements Key Skills 3+ years of Python experience Highly statistical and Analytical Exposure to Google Cloud Platform ( BigQuery, GCS, Datalab, Dataproc, Cloud ML (desirable) Spark & Hadoop experience Strong communication skills Good problem solving skills Qualifications Bachelor's degree or equivalent experience in a quantative field (Statistics, Mathematics, Computer Science … classification techniques, and algorithms Fluency in a programming language (Python, C,C++, Java, SQL) Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau) This is a permanent position, and offers flexibility with Hybrid working, 2-3 days per week in the office, depending on workload more »
Posted:

Kafka Developer

Milton Keynes, England, United Kingdom
Stack Digital
and Primary Objectives We are seeking a highly experienced Kafka Developer with expertise in Kafka Streams and Big Data technologies (Hadoop, Hue, Hive, Impala, Spark). The ideal candidate will have strong knowledge of key-value databases and experience in developing microservices using Spring. The role involves designing and … various 24/7 applications with high-performance requirements. Key Skills/Knowledge Solid experience in Big Data technologies, specifically Hadoop, Hive, Java and Spark/Scala . Advanced SQL knowledge for testing changes and replicating code functionality. Proficient with code repositories like GIT and Maven. Strong DevOps knowledge more »
Posted:

Senior Kafka Developer

Milton Keynes, England, United Kingdom
Maclean Moore
Location: Milton Keynes Key responsibilities: experience as an Kafka Developer (Ideally Kafka Streams). on experience in Big data technologies (Hadoop, Hue, Hive, Impala,Spark,.) and stronger within Kafka. and experience using Key value data bases . Experience developing microservices using Spring. and develop cloud-based data engineering … for different applications ,usually 24/7 applications with a big performance requirement . Key skills/knowledge/experience: Data Hadoop - Hive and Spark/Scala solid experience advance knowledge - Been able to test changes and issues properly, replicating the code functionality into SQL with Code Repositories as more »
Posted:

Information Data Architect

Nottingham, Nottinghamshire, East Midlands, United Kingdom
Microlise
data practices Possess strong knowledge of data tools, data management tools, and various data and information technologies. E.g. DAMA DMBOK, Microsoft SQL Server, Couchbase, Apache Druid, Spark, Kafka, Airflow, etc In-depth understanding of modern data principles, methodologies, and tools Excellent communication and collaboration skills, with the ability … native computing concepts and experience working with hybrid or private cloud platforms is a plus. Demonstrable technical experience working with a Microsoft, Redhat, and Apache data and software engineering environment. A team-oriented individual with a passion for engineered excellence and the ability to lead and motivate a team more »
Employment Type: Permanent
Salary: £70,000
Posted:

Lead Data Engineer

Greater London, England, United Kingdom
OpenCredo
SQL Server, Sybase, Snowflake) Document databases (e.g. Mongo, ArangoDB, Couchbase, Solr) Big Data (e.g. Hadoop ecosystem, Bigtable) Data streaming (e.g. Kafka, Flink, Pulsar, Beam, Spark) Cloud databases (e.g. Snowflake, CockroachDB) Other database genres (e.g. Graph, Columnar, time series) In return, we’ll give you… A competitive basic salary … scheme A high spec laptop (of course!) Need more reasons? Here's a few more... Work with some of the most exciting new technologies Spark off co-workers who’ll challenge your thinking and help you to achieve your potential Deal openly and honestly with customers Benefit from a more »
Posted:

Senior Data Scientist

Manchester Area, United Kingdom
Mobysoft
Senior Data Scientist Mobysoft is one of the fastest growing SaaS providers in the UK and has been shortlisted in the "Top 50 fastest growing technology companies in the North" for four successive years. Mobysoft provides predictive analytical software that more »
Posted:

Senior Machine Learning Engineer

London Area, United Kingdom
Simon James IT Ltd
Machine Learning Engineer AWS & Spark - London We are looking for an experienced hands-on AWS Architect/Cloud Engineer to join a critical project with a Fintech Giant in London. As the Machine Learning expert, you’ll be leading teams that are architecting and building complex systems on AWS … develop scalable systems and offer improvements that will help reduce technical/code/engineering debt. Key Skills: Extensive experience with Machine Learning and Spark/PySpark Recommendation systems, pattern recognition, data mining, artificial intelligence Modern Parallel Computing; distributed clusters, multicore servers, GPU’s Experience with developing machine learning more »
Posted:

Big Data Architect

London, United Kingdom
Concept Resourcing
As a Data Architect, you'll lead the development of Java and Python projects, design API integrations using Spark, and collaborate with clients and internal teams to translate business requirements into high and low-level designs. You'll also define architecture and technical designs, create data flows and integrations … users and client teams. Stay updated with the latest trends and best practices. Qualifications: Expertise in Java and Python development (Essential). Experience with Spark or Hadoop (Essential). Knowledge of Trino or Airflow (Desirable). Proven ability to design and implement scalable and secure solutions. Excellent communication and more »
Employment Type: Contract
Rate: £600 - £700/day
Posted:

Big Data Lead - Leading Tech firm

Greater London, England, United Kingdom
Hybrid / WFH Options
Hunter Bond
My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing numbers … improvements in design, processes, and implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally more »
Posted:
Apache Spark
England
10th Percentile
£52,500
25th Percentile
£63,750
Median
£80,000
75th Percentile
£110,000
90th Percentile
£118,750