10 of 10 Permanent PySpark Jobs in Berkshire

Engineering, with a minimum of 3 years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling, ETL/ ...

database technologies including data lakes such as Azure SQL or SQL Server, PostgreSQL, Snowflake, MySQL, Cosmos DB or Mongo DB with Python and Pyspark Building data warehouse or data lakes with SCVs or in conjunction with CDP platforms Experience of ELT/ETL tools such as Databricks, Azure Data ...

years of hands-on experience in enterprise data modelling using tools such as ERwin, ER/Studio, or Power Designer Proven experience with Databricks, PySpark, Python, SQL, and modern data platform architectures including data lakes and data warehouses Knowledge of batch and streaming ingestion, CI/CD tools (Azure ...

solutions. This will be a long term project with scope for extensions and possible transition to permanent staff. Core Skills Needed: Strong Python development PySpark and SQL expertise Solid understanding of Azure infrastructure Knowledge of Containers, Microservices, and functional design patterns Experience working in Agile environments Terraform ...

optimise CI/CD pipelines in Azure DevOps to automate deployment of workspaces, Unity Catalog, networking, and security. Work with Databricks (Spark/Scala, PySpark) to support ingestion frameworks, data processing, and platform-level libraries. Implement secure connectivity (VNET injection, Private Link, firewall, DNS, RBAC). Monitor, troubleshoot ...

this Senior Data Engineering role, you'll design, develop, and maintain data platforms using technologies such as Snowflake, Databricks, Synapse/Fabric, and PySpark, ensuring the scalability, security, and performance of all data systems. As the Senior Data Engineer your role will be to include establishing and championing best ...

models and manages controlled, production-grade releases to ensure platform stability, scalability, and trusted analytics consumption. Key Responsibilities Design, govern, and operationalize Fabric pipelines, PySpark transformations, and Lakehouse-based Medallion architecture. Translate business requirements and approved data roadmaps into executable technical designs, sprint backlogs, and production-grade delivery plans. ...

LSTM) using TensorFlow, PyTorch, and Keras. Big Data & Data Engineering Architect and implement Big Data solutions using Hadoop, HDFS, MapReduce, Spark, PySpark, and Databricks. Build and maintain DataLake and cloud-native data processing solutions (AWS EMR, Redshift, Kinesis). Ensure performance, scalability, and reliability of distributed data pipelines. … Skills Analytical Tools & Techniques Strong expertise in EDA, statistical modelling, multivariate analysis. Visualization tools: Plotly, Matplotlib, Seaborn. Big Data Technologies Hadoop, MapReduce, HDFS Spark, PySpark, Databricks DataLake architectures, AWS EMR, Redshift, Kinesis Machine Learning Supervised: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN Tree-Based: Decision Trees, Random Forest ...

generative AI applications. - Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. - Design and implement Big Data solutions using Hadoop, Spark, PySpark, and DataLake architectures. - Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). - Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow … systems. Required Skills: Analytical Tools: - EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) - Statistical & Multivariate Analysis Big Data: - Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark - DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning - Supervised Models: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN - Tree-Based Models: Decision Trees, Random Forest, Gradient ...

generative AI applications. - Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. - Design and implement Big Data solutions using Hadoop, Spark, PySpark, and DataLake architectures. - Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). - Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow … systems. Required Skills: Analytical Tools: - EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) - Statistical & Multivariate Analysis Big Data: - Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark - DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning - Supervised Models: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN - Tree-Based Models: Decision Trees, Random Forest, Gradient ...