1 to 25 of 42 Permanent Spark SQL Jobs

considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines … support code reviews, design reviews, and engineering best practices. Your Skills: Strong hands-on experience with Databricks on AWS. Strong experience with Apache Spark/PySpark. Excellent programming skills in Python. Strong SQL skills including complex queries, joins, CTEs, window functions, and query optimization. Experience with ...

more of: GCP, Azure, AWS. An intermediate or better level coding in one or more mainstream coding languages (i.e., Python, SQL, Java, Scala, and R), and critically review the code of other data engineers. Develop code for a range of data products including data matching, rule development, scans … analysis for effective quality assurance and to resolve processing issues. Experience of one or more programming/coding languages listed: Python/PySpark, SQL, Proc SQL, NoSQL, MySQL, SQLite, Spark SQL, Hive SQL, PostgreSQL, SAS, SAS E-guide, Scala, RegEx ...

more of: GCP, Azure, AWS. An intermediate or better level coding in one or more mainstream coding languages (i.e., Python, SQL, Java, Scala, and R), and critically review the code of other data engineers. Develop code for a range of data products including data matching, rule development, scans … analysis for effective quality assurance and to resolve processing issues. Experience of one or more programming/coding languages listed: Python/PySpark, SQL, Proc SQL, NoSQL, MySQL, SQLite, Spark SQL, Hive SQL, PostgreSQL, SAS, SAS E-guide, Scala, RegEx ...

more of: GCP, Azure, AWS. An intermediate or better level coding in one or more mainstream coding languages (i.e., Python, SQL, Java, Scala, and R), and critically review the code of other data engineers. Develop code for a range of data products including data matching, rule development, scans … analysis for effective quality assurance and to resolve processing issues. Experience of one or more programming/coding languages listed: Python/PySpark, SQL, Proc SQL, NoSQL, MySQL, SQLite, Spark SQL, Hive SQL, PostgreSQL, SAS, SAS E-guide, Scala, RegEx ...

more of: GCP, Azure, AWS. An intermediate or better level coding in one or more mainstream coding languages (i.e., Python, SQL, Java, Scala, and R), and critically review the code of other data engineers. Develop code for a range of data products including data matching, rule development, scans … analysis for effective quality assurance and to resolve processing issues. Experience of one or more programming/coding languages listed: Python/PySpark, SQL, Proc SQL, NoSQL, MySQL, SQLite, Spark SQL, Hive SQL, PostgreSQL, SAS, SAS E-guide, Scala, RegEx ...

Implement data quality controls, validation processes, and monitoring solutions. \n\n Data Transformation & Processing \n \n Develop complex data transformation logic using Spark (PySpark or Scala). \n Build data cleansing, enrichment, aggregation, and processing solutions. \n Ensure data accuracy, consistency, and reliability throughout the data life cycle. … Azure Databricks Development \n \n Develop and support solutions within Azure Databricks. \n Work extensively with Unity Catalog, Delta Lake, Spark SQL, and related Databricks services. \n Apply Databricks best practices for development, deployment, and workload optimisation. \n Develop solutions using SQL, Python ...

into data pipelines and services. Conduct bespoke, high-complexity analysis in support of customer-facing or operational needs. Guide team best practices in Spark SQL usage, data documentation, and exploratory reproducibility. Desired Qualifications: 5+ years of experience in data science, applied analytics, machine learning, or analytical … D. Advanced expertise in Python and distributed compute frameworks (e.g., Spark, Databricks), including strong proficiency in Spark SQL . Strong background in statistical inference, anomaly detection, clustering, interaction modeling , or other analytical methods suited to large and heterogeneous datasets. Experience working with multi-source ...

into data pipelines and services. Conduct bespoke, high-complexity analysis in support of customer-facing or operational needs. Guide team best practices in Spark SQL usage, data documentation, and exploratory reproducibility. Desired Qualifications: 5+ years of experience in data science, applied analytics, machine learning, or analytical … D. Advanced expertise in Python and distributed compute frameworks (e.g., Spark, Databricks), including strong proficiency in Spark SQL . Strong background in statistical inference, anomaly detection, clustering, interaction modeling , or other analytical methods suited to large and heterogeneous datasets. Experience working with multi-source ...

into data pipelines and services. Conduct bespoke, high-complexity analysis in support of customer-facing or operational needs. Guide team best practices in Spark SQL usage, data documentation, and exploratory reproducibility. Desired Qualifications: 5+ years of experience in data science, applied analytics, machine learning, or analytical … D. Advanced expertise in Python and distributed compute frameworks (e.g., Spark, Databricks), including strong proficiency in Spark SQL . Strong background in statistical inference, anomaly detection, clustering, interaction modeling , or other analytical methods suited to large and heterogeneous datasets. Experience working with multi-source ...

into data pipelines and services. Conduct bespoke, high-complexity analysis in support of customer-facing or operational needs. Guide team best practices in Spark SQL usage, data documentation, and exploratory reproducibility. Desired Qualifications: 5+ years of experience in data science, applied analytics, machine learning, or analytical … D. Advanced expertise in Python and distributed compute frameworks (e.g., Spark, Databricks), including strong proficiency in Spark SQL . Strong background in statistical inference, anomaly detection, clustering, interaction modeling , or other analytical methods suited to large and heterogeneous datasets. Experience working with multi-source ...

into data pipelines and services. Conduct bespoke, high-complexity analysis in support of customer-facing or operational needs. Guide team best practices in Spark SQL usage, data documentation, and exploratory reproducibility. Desired Qualifications: 5+ years of experience in data science, applied analytics, machine learning, or analytical … D. Advanced expertise in Python and distributed compute frameworks (e.g., Spark, Databricks), including strong proficiency in Spark SQL . Strong background in statistical inference, anomaly detection, clustering, interaction modeling , or other analytical methods suited to large and heterogeneous datasets. Experience working with multi-source ...

into data pipelines and services. Conduct bespoke, high-complexity analysis in support of customer-facing or operational needs. Guide team best practices in Spark SQL usage, data documentation, and exploratory reproducibility. Desired Qualifications: 5+ years of experience in data science, applied analytics, machine learning, or analytical … D. Advanced expertise in Python and distributed compute frameworks (e.g., Spark, Databricks), including strong proficiency in Spark SQL . Strong background in statistical inference, anomaly detection, clustering, interaction modeling , or other analytical methods suited to large and heterogeneous datasets. Experience working with multi-source ...

into data pipelines and services. Conduct bespoke, high-complexity analysis in support of customer-facing or operational needs. Guide team best practices in Spark SQL usage, data documentation, and exploratory reproducibility. Desired Qualifications: 5+ years of experience in data science, applied analytics, machine learning, or analytical … D. Advanced expertise in Python and distributed compute frameworks (e.g., Spark, Databricks), including strong proficiency in Spark SQL . Strong background in statistical inference, anomaly detection, clustering, interaction modeling , or other analytical methods suited to large and heterogeneous datasets. Experience working with multi-source ...

into data pipelines and services. Conduct bespoke, high-complexity analysis in support of customer-facing or operational needs. Guide team best practices in Spark SQL usage, data documentation, and exploratory reproducibility. Desired Qualifications: 5+ years of experience in data science, applied analytics, machine learning, or analytical … D. Advanced expertise in Python and distributed compute frameworks (e.g., Spark, Databricks), including strong proficiency in Spark SQL . Strong background in statistical inference, anomaly detection, clustering, interaction modeling , or other analytical methods suited to large and heterogeneous datasets. Experience working with multi-source ...

cloud-based data pipelines for ingesting, transforming, and storing large volumes of data. Implement scalable, fault-tolerant systems using modern frameworks such as Spark, Temporal, Airflow or Dagster. Develop APIs and services that expose reliable data access, transformation, and orchestration capabilities. Contribute to geospatial data processing workflows using … applications. Desired Qualifications: 3-5 years of experience in data engineering, ideally working with large-scale or geospatial systems. Proficiency in Python and SQL (Spark SQL preferred); experience with distributed data processing frameworks such as Spark, Flink, or Beam. Familiarity with orchestration ...

considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines … architecture review boards, design authority meetings, and client stakeholder workshops. Your Skills: Strong hands-on experience with Databricks on AWS. Strong experience with Apache Spark/PySpark. Excellent programming skills in Python. Strong SQL skills including complex queries, joins, CTEs, window functions, and query optimization. ...

considering: We are seeking an experienced Azure Data Engineering Lead with deep expertise in Azure Databricks, Azure Data Factory (ADF), PySpark, SQL, Delta Lake, and Azure cloud-native data services to drive the design and delivery of enterprise-scale data platforms for leading banking and financial services clients. … Azure Data Factory (ADF), and ADLS Gen2. Expertise in designing scalable, resilient, and enterprise-grade Azure data solutions. Advanced proficiency in PySpark, Python, Spark SQL, and SQL. Strong experience with SQL optimization, performance tuning, joins, window functions, and stored procedures. Extensive experience in developing ...

solutions. Create and maintain technical documentation, standards, and knowledge repositories. Your Profile: Essential skills/knowledge/experience Strong proficiency in Python, PySpark, Spark SQL, DataFrame APIs, Structured Streaming, and Java. Experience developing and maintaining large-scale data processing and mastering pipelines using PySpark. Strong experience … GitLab CI, Azure DevOps, or similar. Experience working with YAML and JSON configuration files and Infrastructure-as-Code concepts. Strong experience with Spark for large-scale data processing using DataFrames, RDDs, and Spark SQL. Hands-on experience developing ETL workflows, lakehouse solutions, dataflows, pipelines, and semantic ...

high-stakes and the upside of getting it right is visible at company level. You'll design and deploy solutions in Python, SQL and Spark SQL, working across Azure Synapse, Snowflake, Databricks and Azure ML. The environment is modern and evolving. You'll help … afterthought Strong candidates will come from a background in data science or applied statistics, with hands-on ML experience and the Python/SQL depth to match. Experience with Azure tooling is useful; the ability to think clearly about business problems and turn them into scalable analytical solutions ...

with modern cloud data platforms (e.g. Databricks or Snowflake), ideally within AWS environments. Advanced programming and data engineering skills in Python, PySpark and SQL, with a solid understanding of ETL pipelines and data transformation. Proven experience in data modelling (end-to-end), including performance optimisation using tools such ...

technical contributor—helping shape new ways of working, supporting system enhancements, and ensuring Finance is equipped with modern, resilient data capabilities. Role Responsibilities SQL, Data Extraction and Transformation Design, develop, and maintain SQL data structures within Microsoft Fabric, writing efficient SQL queries and Python … reports, dashboards, and visualisations. Troubleshoot database-related issues. Monitor and optimize database performance, identifying and resolving bottlenecks and inefficiencies. Conduct regular reviews of SQL code and queries for performance improvements Ensure data security and integrity. Stay updated with the latest database technologies and best practices. Data Warehouse Implement ...

technical contributor—helping shape new ways of working, supporting system enhancements, and ensuring Finance is equipped with modern, resilient data capabilities. Role Responsibilities SQL, Data Extraction and Transformation Design, develop, and maintain SQL data structures within Microsoft Fabric, writing efficient SQL queries and Python … reports, dashboards, and visualisations. Troubleshoot database-related issues. Monitor and optimize database performance, identifying and resolving bottlenecks and inefficiencies. Conduct regular reviews of SQL code and queries for performance improvements Ensure data security and integrity. Stay updated with the latest database technologies and best practices. Data Warehouse Implement ...

technical contributor—helping shape new ways of working, supporting system enhancements, and ensuring Finance is equipped with modern, resilient data capabilities. Role Responsibilities SQL, Data Extraction and Transformation Design, develop, and maintain SQL data structures within Microsoft Fabric, writing efficient SQL queries and Python … reports, dashboards, and visualisations. Troubleshoot database-related issues. Monitor and optimize database performance, identifying and resolving bottlenecks and inefficiencies. Conduct regular reviews of SQL code and queries for performance improvements Ensure data security and integrity. Stay updated with the latest database technologies and best practices. Data Warehouse Implement ...

technical contributor—helping shape new ways of working, supporting system enhancements, and ensuring Finance is equipped with modern, resilient data capabilities. Role Responsibilities SQL, Data Extraction and Transformation Design, develop, and maintain SQL data structures within Microsoft Fabric, writing efficient SQL queries and Python … reports, dashboards, and visualisations. Troubleshoot database-related issues. Monitor and optimize database performance, identifying and resolving bottlenecks and inefficiencies. Conduct regular reviews of SQL code and queries for performance improvements Ensure data security and integrity. Stay updated with the latest database technologies and best practices. Data Warehouse Implement ...

technical contributor—helping shape new ways of working, supporting system enhancements, and ensuring Finance is equipped with modern, resilient data capabilities. Role Responsibilities SQL, Data Extraction and Transformation Design, develop, and maintain SQL data structures within Microsoft Fabric, writing efficient SQL queries and Python … reports, dashboards, and visualisations. Troubleshoot database-related issues. Monitor and optimize database performance, identifying and resolving bottlenecks and inefficiencies. Conduct regular reviews of SQL code and queries for performance improvements Ensure data security and integrity. Stay updated with the latest database technologies and best practices. Data Warehouse Implement ...