101 to 112 of 112 PySpark Jobs in England

Data Engineer Up to £65,000 An exciting opportunity has arisen for a Data Engineer to join an organisation undertaking a significant transformation of its data and analytics landscape. As a Data Engineer, you will ...

Data Engineer Up to £65,000 An exciting opportunity has arisen for a Data Engineer to join an organisation undertaking a significant transformation of its data and analytics landscape. As a Data Engineer, you will ...

DV Cleared Data Engineer Location: West Midlands - Hybrid working Rate: Up to £600 per day Inside IR35 Contract: Until 31 March 2027, with extensions expected Clearance: Active DV Clearance essential The Role We are seeking ...

influence delivery standards and contribute to reusable frameworks and accelerators. What You'll Be Doing Building production-grade data pipelines with Databricks, PySpark and SQL Developing Lakehouse architectures using Delta Lake, Unity Catalog and medallion frameworks Gathering requirements and providing technical guidance to client teams Embedding CI/… team Modernising legacy data platforms to unlock more value from client data estates What You'll Bring Commercial Databricks delivery experience Strong hands-on PySpark and SQL Solid grounding in data engineering, data modelling and Lakehouse architecture Experience on Azure and/or AWS Source control, CI/ ...

Snowflake - Warehouses, Streams/Tasks, Snowpipe, Snowpark, UDFs/Stored Procedures, Time Travel and Cloning. Snowpark and end-to-end pipeline development. Experience with PySpark, Polars or Dask is also valuable. Python, including testing, build tooling and engineering best practices. SQL, including Snowflake-optimised SQL. dbt, including Jinja templating … champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would be advantageous. This is a great opportunity to join a collaborative ...

organisation. Youll design and optimise Spark workloads, build production streaming pipelines and deliver scalable Databricks solutions using Delta Live Tables, Workflows, Unity Catalog, Python, PySpark, Terraform and Databricks Asset Bundles. Key requirements: Advanced Apache Spark and Spark SQL optimisation Production Spark Structured Streaming experience Deep Databricks platform knowledge Strong … Python and PySpark engineering capability Delta Live Tables, Workflows and Unity Catalog Terraform and Databricks Asset Bundles CI/CD and GitHub Actions Ability to work autonomously in a fast-moving environment Experience with Databricks Apps, Lakebase, Airflow, Azure Data Factory, monitoring platforms or financial services would be beneficial. ...

data processing solutions Work with modern data platforms such as Microsoft Fabric, Databricks, or similar technologies Build and optimise data solutions using Python, Spark, PySpark, and/or SQL Support data integration, transformation, and performance optimisation Collaborate with stakeholders to ensure high-quality, reliable data architecture Essential Skills & Experience … Hands-on experience with Microsoft Fabric, Databricks, or equivalent modern data platforms Strong coding experience in Python and/or Spark/PySpark Solid SQL skills and experience working with structured datasets Desirable Experience Knowledge of relational database design , normalisation , and data modelling Experience designing efficient, scalable data architectures ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

blend of experience is expected as the business transitions to Microsoft Fabric, with key skills and core technologies including: SQL, Microsoft Fabric, Python/PySpark, Data Factory, etc. Exposure to and working with AI based tools such as Microsoft Copilot will certainly enhance candidate applications. Managerial and leadership experience … forward your most recent CV for consideration. BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/ ...

development projects. The ideal candidate will have a strong background in ETL, data validation, and SQL, coupled with expertise in test automation engineering using PySpark, Python, and Databricks. You will play a critical role in ensuring the delivery of high-quality software solutions, employing AI-assisted testing and validation … maintain test plans and test cases for ETL processes. Conduct thorough data validation and verification using SQL. Develop and execute automated test scripts using PySpark, Python, and Databricks. Integrate AI-assisted testing methodologies to improve testing efficiency and accuracy. Collaborate with cross-functional teams to identify and resolve defects. ...

AWS Data EngineerLondon | Hybrid | Competitive salary, DOE | Fast interview processJoin an established market leading business with a start-up environment that is building a unique data platform with AI at the core. An innovative consumer ...

Engineers/data science backgrounds with transaction monitoring background The role combines transaction monitoring domain expertise with technical skills in Data Science, Machine Learning, PySpark programming. Experience in designing and deploying AI/ML products, hands-on and as a manager Develop and maintain AI driven monitoring engines that … Machine Learning models on Transaction Monitoring systems. Significant experience as a Data Scientist for complex financial services environments. Technical skills in AI/ML, PySpark, Data Science and knowledge on banking regulatory compliances and financial crime domain knowledge. ...