1 to 25 of 30 Databricks Jobs in Cardiff

of data warehousing and data governance. **Preferred Qualifications:** - Knowledge of DevOps practices and CI/CD pipelines. - Familiarity with cloud-native data platforms (e.g., Databricks). - Understanding of data privacy regulations (e.g., GDPR). #J-18808-Ljbffr More ❯

include, but will not be limited to: Design, build, and optimize high-performance data pipelines and ETL workflows using tools like Azure Synapse, Azure Databricks or Microsoft Fabric. Implement scalable solutions to ingest, store, and transform vast datasets, ensuring data availability and quality across the organization. Write clean, efficient, and More ❯

and Experience Degree (BSc, MSc, or PhD) in Computer Science, Mathematics, or a related field. Familiarity with alternative cloud and data platforms such as Databricks, Snowflake, Azure, or AWS. Knowledge of DevOps/DataOps methodologies and experience with CI/CD pipelines. Understanding of monitoring, logging, and troubleshooting in cloud More ❯

solutions align with NHS requirements and best practices. Develop end-to-end data solutions leveraging Azure services, including Azure Synapse Analytics, Azure Data Factory, Databricks, and Azure SQL. Define data models, integration patterns, and governance frameworks to ensure efficient data management, interoperability, and compliance. Drive cloud migration strategies for NHS More ❯

organisations, through e.g. the RFI/RFP process, as preferred bidder, documented bids and face to face presentations. Experience of data science platforms (e.g. Databricks, Dataiku, AzureML, SageMaker) and machine learning frameworks (e.g. Keras, Tensorflow, PyTorch, scikit-learn) Cloud platforms – demonstrable experience of building and deploying solutions to Cloud (e.g. More ❯

systems Qualifications & Skills: x5 + experience with Python programming for data engineering tasks Strong proficiency in SQL and database management Hands-on experience with Databricks and Apache Spark Familiarity with Azure cloud platform and related services Knowledge of data security best practices and compliance standards Excellent problem-solving and communication More ❯

architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership More ❯

business impact. Responsibilities: Partner with clients to identify data challenges and develop solutions using Microsoft Fabric. Design data architectures integrating Azure Synapse, Data Factory, Databricks, and Power BI. Manage end-to-end solution delivery, ensuring performance and scalability. Develop data models and pipelines for real-time insights. Optimize systems for More ❯

a plus) Strong knowledge of data governance, data quality, and metadata management Proficiency in Power BI, SQL, and Azure-based platforms (Synapse, Data Factory, Databricks) Familiarity with data regulations (GDPR, FCA) and SMCR environments Bonus points for experience with Python, R, or PySpark Why You Should Apply: Executive-level visibility More ❯

col-narrow-right Job Views: 3 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Data Analytics Senior Sales Consultant – Data Analytics, snowflake, talend, databricks, salesforce, hubspot, SaaS, data lakes, apis, adtech, GDPR, CCPA, B2B, Sales Consultant, Account Manager, DataOps, CICD, DevOPs, CI/CD, GenAI, RAG, AWS, Azure, Apache More ❯

strong Java coding experience, and experience working with Java management tools for our client in the IT Services and IT Consulting industry. Data Migration & Databricks experience is also essential for this role. You will perform complex research, design, and software development assignments within a specific software functional area or product More ❯

both technical and non-technical audiences. Technical Skills Strong knowledge of SQL and Python. Experience with cloud environments. Experience with big data technologies (Spark, Databricks, Delta Lake, BigQuery). Experience with alternative data technologies (duckdb, polars, daft). Familiarity with eventing technologies (Event Hubs, Kafka). Understanding of file formats More ❯

of the following: Strong knowledge of SQL and Python programming. Extensive experience working within a cloud environment. Experience with big data technologies (e.g. Spark, Databricks, Delta Lake, BigQuery). Experience with alternative data technologies (e.g. duckdb, polars, daft). Familiarity with eventing technologies (Event Hubs, Kafka etc ). Deep understanding More ❯

of the following: Strong knowledge of SQL and Python programming. Extensive experience working within a cloud environment. Experience with big data technologies (e.g. Spark, Databricks, Delta Lake, BigQuery). Experience with alternative data technologies (e.g. duckdb, polars, daft). Familiarity with eventing technologies (Event Hubs, Kafka etc...). Deep understanding More ❯

across teams to embed data science into core business processes What You'll Bring: · Strong Python, SQL, and statistical modelling expertise · Deep knowledge of Databricks, Lakehouse architecture & cloud platforms · Proven experience delivering end-to-end data science projects · Excellent stakeholder management and communication skills · Passion for ethical AI and data More ❯

on experience with ML frameworks (PyTorch, TensorFlow, Keras). Proficiency in Python and C/C++. Experience with scalable data tools (e.g., PySpark, Kubernetes, Databricks, Apache Arrow). Proven ability to manage GPU-intensive data processing jobs. 4+ years of applied research or industry experience. Creative problem-solver with a More ❯

this year, we employ over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the … scalable data pipelines to serve the easyJet analyst and data science community. Highly competent hands-on experience with relevant Data Engineering technologies, such as Databricks, Spark, Spark API, Python, SQL Server, Scala. Work with data scientists, machine learning engineers and DevOps engineers to develop, develop and deploy machine learning models … and how to use dedicated hardware. Significant experience with Apache Spark or any other distributed data programming frameworks (e.g. Flink, Hadoop, Beam) Familiarity with Databricks as a data and AI platform or the Lakehouse Architecture. Experience with data quality and/or and data lineage frameworks like Great Expectations, dbt More ❯

and optimize data models, warehouse solutions, and ETL processes. Work with Scala, Spark, and Java to handle large-scale data processing. Contribute to manual Databricks-like data processing solutions. Requirements: Minimum of 4 years of experience with Scala, Spark, and Java. Strong technical skills and a passion for working with More ❯

modelling, data mesh, data lake) & best practices (agile, CI/CD, IaC, observability). Experience with Cloud and big data technologies (e.g. Spark/Databricks/Delta Lake/BigQuery). Familiarity with eventing technologies (e.g. Event Hubs/Kafka) and file formats such as Parquet/Delta/Iceberg. More ❯

Skills: Proven background in platform selection, configuration, and onboarding (ideally across AWS, cloud, or on-prem solutions). Hands-on familiarity with tools like Databricks, Python, and SaaS analytics environments. Experience working within a CTO or principal engineering team to translate complex technical concepts into language understood by functional users. More ❯

This Role Stands Out Play a key role in shaping Azure data strategies for enterprise clients Join a pioneering team adopting Fabric, Synapse, and Databricks in production Be part of a community of thought leaders, with the opportunity to share ideas and influence outcomes Home-based flexibility with a focus … to knowledge sharing Ideal Experience Proven track record delivering data solutions in the Azure ecosystem Deep expertise across the Azure Data Platform (Fabric, Synapse, Databricks, Data Lake, Data Factory, Purview, etc.) Strong data pipeline and ETL skills, including data modelling and transformation Experience implementing Medallion Architecture (Bronze, Silver, Gold layers … in lakehouse or Databricks environments Familiarity with DevOps, CI/CD, and agile delivery Azure Data Engineer, Fabric Engineer, or related certifications—or motivation to earn them What’s In It for You? Up to £75K base salary plus performance bonus Fully remote role with minimal travel expectations Access to More ❯

to play a key role in delivering the next phase of a business-critical data programme. You'll apply your technical expertise across Azure Databricks, Data Factory, Azure SQL, and SQL Server, contributing directly to the integration of financial data into a new Azure Data Platform. Online job hunting tools … Responsibilities: Design, build and optimise scalable data solutions using Azure cloud technologies. Lead the development of data pipelines in Azure Databricks, Data Factory, and T-SQL. Provide senior-level technical direction to onshore and offshore development teams. Translate data requirements into effective data engineering solutions. Collaborate closely with business stakeholders … Plan and manage progress in Agile sprints alongside project managers and scrum masters. Requirements: Extensive experience in Azure data engineering, with strong expertise in Databricks, Azure SQL, and Data Factory. Deep technical knowledge of SQL Server including stored procedures and complex data transformation logic. Proven experience in designing and delivering More ❯

Social network you want to login/join with: Software Tech Lead - Python, Databricks, Cloud, cardiff col-narrow-left Client: IC Resources Location: cardiff, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: My … projects, ensuring alignment with broader company objectives and vision. Extensive hands-on software engineering background, primarily based around their core data capabilities of Python, Databricks, AWS, Azure. Ideally, you will have a background of working within data analytics/data intelligence organisations. Strong experience designing, building, and supporting infrastructure in More ❯

Social network you want to login/join with: Ready to join a team that's leading the way in reshaping the future of insurance? Here at esure Group, we are on a mission to revolutionise insurance for good! We More ❯

experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark … spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools #J-18808-Ljbffr More ❯