6 of 6 PySpark Jobs in Manchester

data warehouse or data lakes with SCVs or in conjunction with CDP platforms Knowledge of data ingestion of streaming data using Databricks and Pyspark Understanding and application of statistical methods Ability to lead, and to work well as part of, a team using the agile methodology Desirable Skills: Palantir ...

ideally in enterprise-scale environments Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse, and Azure Data Lake Hands-on experience with Spark (PySpark/SparkSQL) and distributed data processing Strong data modelling skills (Dimensional, ODS, Data Vault) and data warehousing concepts Proficiency in SQL, version control ...

data architecture aligns with organizational goals. • Ensure data governance, performance, and security best practices are followed. Skills & Qualifications: • Strong experience with Azure Databricks and PySpark • Expertise in Azure Data Factory • Proficiency with Azure API Management, Function Apps & Logic Apps • Hands-on experience with event-driven architecture in Azure • Strong ...

Strong knowledge of AWS data services (Glue, S3, Lambda, Redshift, etc.) Solid understanding of ETL processes and data pipeline management Proficiency in Python and PySpark Experience working with SQL-based platforms Previous involvement in migrating on-premise solutions to cloud is highly desirable Excellent collaboration skills and ability ...

1. Azure Databricks, Pyspark 2. Azue Datafactory 3. Azure API mangement service 4. Azure Function apps, Logic apps 5. Event Driven architecture within Azure using Event Hub, Service bus, Function apps ,cosmos db etc 6. Strong Data modeling experience, Data lake and Data Warehouse. ...

. Maintain/implement data warehousing solutions and manage large-scale data storage systems (e.g. Microsoft Fabric) Build and optimise SQL queries, stored procedures, PySpark notebooks and database objects to ensure data performance and reliability. Migrate and modernise legacy databases to cloud-based architectures. Database Administration Administer, monitor … normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations ...