1 to 4 of 4 Contract Apache Spark Jobs in the UK excluding London

Python, Bash, or Ruby for automation tasks. ? Experience automating infrastructure tasks, especially around application performance. ? Application Profiling: ? Expertise in application performance profiling tools (e.g., Apache JProfiler, YourKit, VisualVM) to analyze resource consumption, thread behavior, and response times. ? Hands-on experience with profiling Hadoop applications, understanding resource allocation, job execution … Strong understanding of the Hadoop ecosystem (HDFS, MapReduce, YARN, Hive) and the ability to profile and optimize resource usage within distributed systems. ? Familiarity with Apache Spark and Hadoop performance tuning is a plus. Tools & Technologies: Automation & Profiling: ? Chef InSpec (for automation and compliance testing) ? Scripting: Python, Bash, Ruby … Application Profiling Tools: Apache JProfiler, YourKit, VisualVM or equivalent tools for Java-based applications ? Hadoop-specific tools: Hadoop Profiler, Ganglia, Ambari Metrics Monitoring & Data Visualization: ? Grafana (for setting up performance dashboards and real-time monitoring) ? Prometheus (for collecting and querying performance data) ? Prometheus data formats (for custom metrics creation more »

Engineer to join our blue-chip client's dynamic team. The ideal candidate will have extensive hands-on experience in data engineering, particularly with Spark , Python , and Java . A background in banking or financial services is highly desirable, as you will work on projects that require domain-specific … solving complex problems, and thrive in a hybrid work environment, this role is for you! Key Responsibilities: Develop and optimize scalable ETL pipelines using Spark and other big data technologies. Work on large datasets using HDFS , Hive , and similar tools in the big data ecosystem. Implement and maintain CI … quality, availability, and performance in production environments. Core Skills & Experience Required: Minimum of 8+ years of experience in data engineering. Hands-on experience with Spark 2.x/3.x . Proficiency in Python (or Scala/Java ), with a preference for Python. Strong knowledge of HDFS , SQL , and experience in more »

Azure Data Architect Tourism and Hospitality industry 6 months + £(Apply online only) per day Inside IR35 Remote/London twice a week Spark, kafka, Azure, Databricks, python Leading consultancy firm are actively recruiting for an experienced Azure Data Architect expertise in designing and implementing data architectures across various … Data Lake Storage (ADLS), Azure Data Factory (ADF), EventHub/Kafka/Confluent, and Synapse, to build and optimize data pipelines. Integrate Databricks and Spark for advanced data processing and analytics, ensuring seamless data flow and accessibility. Utilize Dynamics 365 and Power BI for CRM data management and visualization … designing future state data architectures (data lakehouse, ODS, MDM). Experience in data cataloguing, data mapping, and conducting data capability maturity and gap analysis. Spark, kafka, Azure, Databricks, python more »

with experience of CI/CD tools Azure cloud Building, maintaining, and optimising Databricks Familiarity with DevOps principles and tools Kafka or any other Spark implementation Platform Data Ops Engineer, Databricks, Kafka, IAC, Azure more »