201 to 225 of 6,996 Permanent SQL Jobs

Data Engineer London - Hybrid £65,000 - £75,000 Azure Data/SQL/Financial Services I'm currently working with a growing data and technology consultancy who are looking to bring a Data Engineer into their expanding delivery team. The business works with a range of organisations across telecommunications, financial … office 2 days per week. Key Responsibilities Develop and maintain scalable data pipelines using Azure Data Factory. Build and manage ETL processes using SQL and Python. Work with Azure Databricks and Azure SQL/SQL Server to process and manage large datasets. Design and implement data models using Kimball ...

Data Engineer London - Hybrid £65,000 - £75,000 Azure Data/SQL/Financial Services I'm currently working with a growing data and technology consultancy who are looking to bring a Data Engineer into their expanding delivery team. The business works with a range of organisations across telecommunications, financial … office 2 days per week. Key Responsibilities Develop and maintain scalable data pipelines using Azure Data Factory. Build and manage ETL processes using SQL and Python. Work with Azure Databricks and Azure SQL/SQL Server to process and manage large datasets. Design and implement data models using Kimball ...

experience as a Senior Data Engineer in enterprise data environments. Technical stack: Microsoft Azure data platforms, including Azure Synapse or equivalent data platform, Azure SQL Server, Azure Data Factory, Azure DevOpsThis is a new opportunity to join a thriving team to be a key voice in modernizing core data platforms … ingestion and staging layer, including: Synapse Link integrations. Synapse data pipelines for orchestration and movement. Support the Enterprise Data Warehouse (EDW) built on Azure SQL Server, including: Transformations using stored procedures, views, and DBT.Clear separation of bronze, silver, and gold layers aligned to a medallion architecture. Collaborate with ...

Designing, building and maintaining data pipelines in Databricks Developing and optimising ETL/ELT processes across ingestion, transformation and integration Building data solutions in SQL, Python and PySpark Monitoring and improving data quality, reliability and platform performance Supporting SQL database administration, maintenance and optimisation Tuning queries, indexes and execution plans … stakeholders across the business Helping mature automation, documentation, development standards and CI/CD practice Essential Skills and Experience Strong experience with Databricks SQL server experience Solid Python and PySpark skills Experience using MS stack, Azure and Spark Familiarity with CI/CD and DevOps Why Apply? Base salary ...

Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches for analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks Apply infrastructure-as-code and automation to deploy and manage data platforms Build data quality, validation, monitoring and observability into engineering … designing and delivering data solutions on AWS Strong knowledge of AWS data services including S3, Glue, Lambda, Athena, Redshift and EMR Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines and data processing workflows Understanding of data modelling, data lakes, data warehouses and modern data ...

play a key role in rebuilding a modern cloud-based data platform while working with cutting-edge technologies including AWS, Redshift, Power BI, SQL, and Python . If you thrive on solving problems, uncovering insights and building data solutions that drive business value, we'd love to hear from you. … data function, helping transform raw data into actionable intelligence. You'll be responsible for: Developing and enhancing a cloud-based Data Warehouse using SQL Designing and maintaining ETL pipelines using AWS Glue and related technologies Building impactful dashboards and visualisations in Power BI Partnering with stakeholders across the business ...

Integration service environment, configuring monitoring & diagnostics, etc., and connectivity & security configurations (certificates, encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes. Knowledge and some experience of MS Office/MS Office 365 suite … Request/Response, Service Bus, Publish/Subscribe, Batch/Real-time, Scheduling, Event triggers, etc. In-depth knowledge and development experience using MS SQL Server (SSIS, T-SQL, Stored procedures, Functions, Views, Queries, Datatype conversions, etc.). Thorough understanding of the fundamental architecture of the cloud and on-prem ...

development and optimisation of analytics solutions. You will work closely with cross-functional teams to design, implement, and maintain robust analytics pipelines in SQL , leverage your expertise in Databricks using Python , and create impactful visualisations using Tableau or Power BI and other relevant technologies. This is a fantastic opportunity … maintain dashboards and reports to visualise and communicate insights derived from complex datasets . Design and implement scalable data pipelines using Databricks and SQL/Spark for efficient data processing and analysis. Collaborate with stakeholders to understand business requirements and translate them into analytical solutions. Optimise and enhance existing analytics ...

disciplines within enterprise environments 4+ years of hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform Strong expertise in Apache Spark, SQL, Python, Delta Lake, and modern data engineering practices Experience building and optimizing Extract, Transform, Load and Extract, Load, Transform data pipelines for scalable analytics … Databricks Lakehouse Platform. Design and implement scalable data and analytics solutions leveraging Databricks technologies Build, maintain, and optimize data pipelines using Apache Spark, SQL, Python, and Delta Lake Develop governed datasets and data products that support reporting, analytics, and artificial intelligence initiatives Partner with business stakeholders and technical teams ...

disciplines within enterprise environments 4+ years of hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform Strong expertise in Apache Spark, SQL, Python, Delta Lake, and modern data engineering practices Experience building and optimizing Extract, Transform, Load and Extract, Load, Transform data pipelines for scalable analytics … Databricks Lakehouse Platform. Design and implement scalable data and analytics solutions leveraging Databricks technologies Build, maintain, and optimize data pipelines using Apache Spark, SQL, Python, and Delta Lake Develop governed datasets and data products that support reporting, analytics, and artificial intelligence initiatives Partner with business stakeholders and technical teams ...

disciplines within enterprise environments 4+ years of hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform Strong expertise in Apache Spark, SQL, Python, Delta Lake, and modern data engineering practices Experience building and optimizing Extract, Transform, Load and Extract, Load, Transform data pipelines for scalable analytics … Databricks Lakehouse Platform. Design and implement scalable data and analytics solutions leveraging Databricks technologies Build, maintain, and optimize data pipelines using Apache Spark, SQL, Python, and Delta Lake Develop governed datasets and data products that support reporting, analytics, and artificial intelligence initiatives Partner with business stakeholders and technical teams ...

expect to be involved in the following: Design and develop scalable ETL and ELT pipelines across operational, analytical, and AI data environments. Build robust SQL and Python-based data solutions for production use. Develop and enhance data models that support analytics, machine learning, and customer insight initiatives. Contribute … successful Senior Data Engineer will have the following skills and experience: Strong commercial experience in Data Engineering and cloud-based data platforms. Advanced SQL skills and experience building transformation pipelines. Strong Python capability for orchestration, automation, and data tooling. Excellent understanding of dimensional modelling and scalable data architecture. Experience working ...

Glue, Lambda, Athena, Redshift, EMR and related technologies • Design data models and storage approaches appropriate to analytical and operational requirements • Develop solutions using Python, SQL and modern data engineering frameworks • Apply infrastructure-as-code and automation approaches to the deployment and management of data platforms • Build data quality, validation, monitoring … data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements • Strong Python and SQL skills • Experience designing and building scalable ETL/ELT pipelines and data processing workflows • Good understanding of data modelling, data lakes, data warehouses and modern data ...

data solutions. Key Responsibilities Engage directly with business stakeholders, report owners, and customers to gather, analyze, and refine business requirements. Translate business requirements into SQL-based data analysis, reports, dashboards, and actionable insights. Perform root cause analysis and investigate data quality, reporting, and operational issues. Develop ad hoc analyses, prototypes … ensuring alignment with business objectives. Drive continuous improvement in reporting, analytics processes, and data governance practices. Required Skills & Experience Technical Skills Strong expertise in SQL with the ability to write complex queries, troubleshoot issues, and perform advanced data analysis. Proficiency in Python for data analysis, data profiling, exploratory analysis ...

routing across internal and external systemsBuild robust Python-based services, APIs, and microservices supporting portfolio analytics, optimization workflows, and data pipelinesDesign and optimize SQL-based data processing (PostgreSQL, SQL Server), including complex queries, performance tuning, and large-scale ETL workflows. Implement and support distributed, event-driven architectures (e.g., Kafka, asynchronous … engineering or data engineering (financial services or asset management experience preferred). Proven Python experience, including data processing, APIs, or service-based architecture. Proven SQL experience (PostgreSQL, SQL Server, and/or Snowflake), including performance tuning and ETL workflows. Experience with cloud-native development (AWS) and containerized environments. , Experience with ...

teams, with 10+ years of software development/engineering experience, including 5+ years in a team-based environment. Technical skills needed include expertise in SQL and relational data modeling; Microsoft .NET technologies (C#, ASP.NET Core, REST APIs); Azure cloud solutions; GitHub Enterprise and CI/CD automation; enterprise application … priorities, collaborate with diverse stakeholders, and thrive in a fast-paced environment are necessary. Preferred Qualifications: Experience in enterprise software development; Microsoft technologies including SQL Server, Power Platform, Fabric, and Power BI; Azure cloud services and AI technologies such as Azure AI, OpenAI, Copilot Studio, Semantic Kernel, and RAG architectures. ...

capturing requirements and Governance & Control documentation, knowledge of GDS is an added advantageApplied experience of metadata analysis, fields/entity, and data lineage, sql/no sql databasesExperience with one of Azure/AWS/GCPETL tools like Informatica, Alteryx and Business Glossary tools like Collibra, Azure Purview or Apache ...

Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions Knowledge of AWS, Azure, GCP and/or Snowflake Strong understanding of data governance, data ...

Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions Knowledge of AWS, Azure, GCP and/or Snowflake Strong understanding of data governance, data ...

that too. We are looking for an experienced Data Developer with an interest and experience in providing data analytic solutions utilising Power Apps and SQL to clients on major construction and infrastructure projects. In this team you will play a crucial part in delivering and monitoring Energy programmes which … Strong requirement-gathering and stakeholder management skills. Excellent business acumen and ability to map analytics to measurable business outcomes. Understanding of Python and SQL is not required but would be beneficial Solid knowledge of ETL, ETL design patterns, data warehousing and data governance. Problem solving mindset. Familiarity with Microsoft Azure ...

Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks Apply infrastructure-as-code and automation approaches to the deployment and management of data platforms Build data quality, validation, monitoring … data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines and data processing workflows Good understanding of data modelling, data lakes, data warehouses and modern data ...

Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks Apply infrastructure‐as‐code and automation approaches to the deployment and management of data platforms Build data quality, validation, monitoring … data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines and data processing workflows Good understanding of data modelling, data lakes, data warehouses and modern data ...

systems specifications. Work with development teams to design technical solutions that meet business needs. Produce analysis, data mapping and data analytical skills using SQL, Excel and Power BI Produce detailed Business Requirement Specification Documents. Stakeholder management across all levels from c-suite through to on-the-ground developers both internally … both large-scale and smaller projects and has been responsible for defining and designing business solutions. Discovery, technical, and data capability with strong SQL Background Confident, articulate, and proactive consultants Good project management skills with the ability to plan and schedule own work and work towards tight deadlines. Excellent communication ...

architects, engineers, and analysts to deliver secure, scalable, and high-performing migration solutions, leveraging technologies such as AWS Glue, Apache Iceberg, Python/PySpark, SQL, and YAML-based configurations. You will thrive in a collaborative, client-facing environment, with a passion for solving complex data challenges, ensuring delivery excellence … acceleratorsPython/PySpark transformationsSQL-based logicYAML configuration-driven orchestrationExecute and validate: Initial bulk data loadsSubsequent incremental/delta migrationsDevelop and run SQL-based validation and reconciliation queries to ensure: Data completenessData accuracyTransformation correctnessSupport creation of automated testing and validation frameworksAWS Data Platforms & LakehouseWork hands-on with AWS cloud services, including ...

feed pipeline migrations repointing from an existing Data Warehouse to a new AWS Data Lakehouse architecture, underpinned with AI ETL accelerators, Python/PySpark, SQL and YAML configs. Test initial bulk then deltas from legacy to new. Execute automated test suites as part of sprint-based delivery and regression cyclesDefect … practically applied the principles Experience in AWS cloud services, AWS Glue. Experience with Python/PySpark. Experience with writing and running SQL queries. Experience with YAML configuration. Experience with CI/CD GITHUB Actions (or similar)Knowledge of AI-driven testing solutions and automation accelerators to maximize test efficiency ...