14 of 14 ETL Jobs in West London

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business and technology teams Essential Experience Proven Data Architect experience ...

promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will Write ETL (Extract/Transform/Load) processes, designs database systems and, develops tools for real-time and offline analytic processing Troubleshoot software and processes for data ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot data issues and ensure solutions are secure, scalable and ...

looking for: 24 years' experience in data engineering Strong SQL, Python and DBT skills Experience with AWS and/or Databricks Experience building ETL/ELT pipelines and data warehouses Knowledge of AWS services such as S3, Lambda and Glue Familiarity with Git and infrastructure-as-code tools such ...

Engineering: Proficiency in SQL and relational databases (e.g., PostgreSQL, DuckDB). Experience with the modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). ...

core data warehouse. Define end-to-end data architecture, including ingestion, transformation, storage, governance, and reporting. Lead migration of Legacy data warehouses and ETL workloads to GCP and BigQuery. Design optimized BigQuery schemas, partitioning, clustering, and performance tuning strategies. Develop data pipelines using Cloud Dataflow, Dataproc, Cloud Composer, Cloud Functions ...

QUALIFICATION Hands-on experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team ...

Hands-on experience with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team ...

Hands-on experience with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...

Azure Data Engineer to join our agile teams. As a Data Engineer, you will work in a product delivery team using your data analysis, ETL and cloud technology skills to discover, model, provision and store data at scale in the cloud. This data will be then converted into data products … databases and storage to Azure cloud-based lake and warehouse Key Requirements: Essential Skills: Minimum 2+ years’ hands-on experience designing and developing complex ETL/ELT pipelines in the cloud (Azure Data Factory and Azure Synapse) Experience of preparing data mappings based on high level requirements and taking those ...

Architect - Manager Design and implement end-to-end data solutions from ingestion and processing through to analytics and visualisation. Design scalable data pipelines and ETL processes across modern and legacy platforms. Develop conceptual, logical and physical data models, including dimensional, relational and data vault. Own end-to-end data architecture … architecture methods, tools and technologies. Experience you'll need as a AI & Data Architect - Manager 5+ years experience in data engineering and architecture , including ETL, data pipelines and data storage. Experience leading data engineering projects or workstreams. Strong experience with cloud platforms and cloud data services . Experience with modern ...

based tooling. Manage AWS infrastructure supporting a mix of React front -end applications, microservices, AWS Lambda functions, and Kafka event integrations. Support integrations involving ETL processes and Robotic Process Automation (RPA) solutions. Implement and manage secure networking patterns, including AWS Transit Gateway and PrivateLink where required. Support the deployment and … governance and FinOps practices, including resource tagging standards. Strong troubleshooting and problem -solving skills. Experience working within Agile delivery teams. Desirable Skills Experience supporting ETL pipelines and data integration solutions. Exposure to Robotic Process Automation (RPA) platforms. Experience delivering services within UK Government or highly regulated environments. Familiarity with accessibility ...

and automating cloud infrastructure. What You'll Be Doing Designing, developing and maintaining scalable data applications and engineering solutions within GCP. Building production-grade ETL and data processing pipelines handling large volumes of data. Developing cloud-native applications and services using Python, Go and BASH . Working extensively with … and data pipelines within Google Cloud Platform . Hands-on knowledge of BigQuery, Pub/Sub and Dataflow . Experience designing and developing scalable ETL/data processing solutions . Good understanding of software engineering principles , testing and production-grade development. Strong experience with Infrastructure as Code , particularly Terraform and ...

initial 6-month contract. The role focuses on cloud-native data applications and scalable pipelines within Google Cloud Platform. You will design and build ETL pipelines, leverage Python/Go/BASH, and automate cloud infrastructure with Terraform and Ansible in a hybrid setup with limited onsite requirements. #J ...