26 to 50 of 550 Data Engineer Jobs

shop and this role will face off with a range of business leads in order to build the pipelines that will ultimately ingest the data for their new strats! Responsibilities: Design and implement scalable ETL solutions (structured and unstructured; batch and streaming) Building data pipelines, standardizing, and cleansing … data for the investment team Define and set best practice standards surrounding data (i.e., data modelling, database design, ETL design, job scheduling and monitoring, etc) Manage the entire data flow, from acquisition to transformation into actionable insights using SQL and Python/Java Design and maintain … APIs Requirements: Degree in Computer Science. 4+ years of professional software development experience. A passion for data and experience in applying that passion to high quality data products. Strong knowledge of software engineering best practices, object-oriented concepts, and the ins and outs of data-focused development. more »

We have a very important mandate from a leading hedge fund that who are looking for a Senior Data Engineer to join a group formed only 3 months ago. They would be one of the first Data Engineers on the ground with full autonomy. This organization specifically … within the firm. The project itself cannot be disclosed yet as it is in such early stages but in regard to the amount of data you would be dealing with - THE SKY IS THE LIMIT!! Additionally, the firm has a real focus on introducing new technology if it can more »

Job Title: Cloud Data Engineer Location: Northampton,UK Hybrid work: 2-3 days a week Capgemini is seeking a Cloud Data Engineer t o join Capgemini Financial Services I&D Practice. This is a permanent, full-time position in Northampton, UK and this represents a unique … opportunity for someone to enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data Build … Tool) for managing transformations in the data pipeline. Strong programming skills in technologies like Python, Scala, Spark, PySpark or Ab Initio, Glue, Starburst, Snowflake, Redshift, Starburst, Hybrid(on-prem to cloud) for building data pipelines and ETL processes. Experience with data pipeline orchestration tools like Apache Airflow more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to … start interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If more »

We are looking for a Data Engineer to join our Y Combinator backed start-up. They are using AI and ML technology to build a SaaS product. You will be working closely with the Data Scientists and wider engineering teams. Responsibilities Maintaining Python/SQL ETL pipelines … AI capabilities Collaborate with several teams to provide technical solutions Requirements Early-stage start-up passion Strong Python knowledge Experience building and optimizing "big data" pipelines more »

TL;DR 🧢 Role | Senior Data Engineer 💫 Company | InsurTech, Scale-up, Data 📏 Size | c.100 🎯 Areas | Data Pipelines, ETL, Cloud Infra, DataOps, Data Models, Machine Learning ✨ Tech | Python, ETL, SQL (all flavours), GCP 📍 Based | London (Zone 1) 💻 Hybrid | 2 days a week in-office 💰 Offer | Up to … over half a billion $ in funding. 2024 is the year they 10x their client base. That's where you come in... 💥 As a Senior Data Engineer you will: be designing and developing complex data processing modules ranging from ETL to ML, working closely with the firm's … core algo team, who are developing the machine learning models that underpin the value my client provides to its customers collaborate with data scientists and engineers to design, build, optimise and maintain production grade data pipelines to feed the company's core algos create frameworks, infrastructure and systems more »

employees worldwide. We aim to create diversity in the tech market and support the growth of the renewable energy sector. As a Management Information & Engineer, you will play a pivotal role in supporting and enhancing our business applications landscape, with an initial focus on Mercury XRM, our PowerApps-based … Customer Relationship Management (CRM) solution built on MS Dynamics 365. This role demands a deep understanding of data modelling, application integration, and support mechanisms to ensure optimal performance and user satisfaction. You will leverage Power Automate to streamline CRM workflows and require strong PowerBI skills for data analysis … and reporting. Additionally, expertise in JSON and Java is essential for potential integrations and customization tasks along with skills in Python for handling large data sets. This hands-on position requires not only technical acumen but also a strategic vision for data management information reporting within our organisation. more »

Data Engineer - Leading Pharmaceutical Company - Exeter (Tech Stack: Data Engineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented Data Engineer looking for a new challenge? Our client, a leading pharmaceutical company based in Exeter, is seeking a dedicated and … skilled Data Engineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python for … data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth knowledge of more »

Eames Consulting are delighted to be supporting an established Investment management company that are looking for a Data engineer. Responsibilities: Develop and maintain complex SQL queries, customize reports, and optimize data usage. Create tools to address business challenges and empower users with third-party tools. Design and implement … cloud-based data platforms, ETL pipelines, and data integration. Collaborate with colleagues to ensure data integrity, quality, and security standards are met. Experience required: 3 years experience working as a Data engineer or similar Strong proficiency in SQL or Data Bricks and database development … including complex query optimization and performance tuning. Comfortable using programming languages such as Python Strong Data Warehousing experience - building data pipelines from scratch Good understanding of open source, big data, and cloud data platforms (e.g. AWS, Azure); given a business problem, you can analyse and evaluate more »

Data Engineer Azure/Snowflake/Python London (Contract) Role: Our client is looking to expand their data engineering team and add in the utilisation of Snowflake which is currently being used by a select few members of the team, and upskilling taking place alongside. They want … to add in an additional team member who has multiple years of experience using Snowflake as a data tool and can hit the ground running Experience Snowflake Financial services Cloud (Ideally azure) Airflow would be an advantage more »

Lead Data Engineer with Palantir Foundry Remote (UK & Europe) Contract NOTE:- The Resource Needs to work In European Time Zone Description: Total experience of 7+ years in Data Engineering and must have at least 3 years of experience in Palantir Foundry. Strong experience with Palantir Data Engineering features such as, Code Repo, Code Workbook, Pipeline Build, migration techniques, Data Connection and Security setup. Design, develop Data Pipelines, and have excellent skills in PySpark and Spark SQL, hands on with code Build and deployment in Palantir. Must lead a team of 6-7 technical more »

Data Engineer| 12-Month FTC | Hybrid | ODI/ETL tool | Snowflake | Tech4Good | AWS| Bristol| Your new company: How would you like to join a well-established, tech for good company with a huge focus on data, using a powerful, mission critical ecosystem of Data/BI … committed to working within a team to drive important business decisions, with strong experience of stakeholder management. What will this role look like? - Build Data Warehouses to facilitate analytics and insights. - Build data integration and transformation routines to target data stores using ETL toolsets. - Building data structures to facilitate data driven insights using BI tools – Tableau, Oracle DV etc. - The work involves on premise and cloud platform environments, covering relational databases (PostreSQL, Oracle) and file stores (AWS S3). - Which of your skills will be used? - Building data warehouse solutions (using Oracle data more »

We are working on behalf of an International (Re)Insurance client based in London to recruit a Lead/Senior Data Engineer, joining an established team of Analytics Engineers helping optimise the Actuarial teams' efficiency through data automation and the use of emerging technologies. The successful candidate … will work on the following: - Actuarial Data Infrastructure - Data Engineering - Data Analysis & Visualisation We are looking for someone with Python and ideally SQL in conjunction, working knowledge of Power BI, and ideally Microsoft Azure (or similar such as AWS). Knowledge of API's is also helpful. … It will appeal to someone eager to join a collaborative team who are playing an important role in driving the use of data forward. This candidate is expected to have prior relevant experience as a Lead or Co-Lead on development projects, not necessarily within an insurance environment. Ability more »

Data Engineer – London - £100,000 Description My client, a prominent figure in the insurance industry are on the hunt for a Data Engineer to join there ever growing Data team. The right individual will have a passion for Data as well as being able … to communicate to non-technical stakeholders. The right Data Engineer will ideally have experience working with Azure however my client are open to seeing people equally AWS/GCP. Responsibilities Designing and implementing scalable and efficient data storage solutions on Azure. Building and maintaining data pipelines … to ingest, process, and transform large volumes of data. Collaborating with data scientists and analysts to understand their requirements and develop optimized data models. Monitoring and troubleshooting data pipeline performance issues. Implementing security measures to protect our data assets. Conducting regular data quality checks and more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This is the chance to work for a unique organisation! Our client is a not-for-profit charity that reviews/certifies companies … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You more »

Data Engineer Do you want to join a leading investment firm specializing in quantitative trading, driven by innovation and excellence? Keep reading! 📍 Location : London, UK As a Data Engineer , you'll build and maintain infrastructure for trading strategies, collaborating with data scientists and analysts. Responsibilities … Data Pipelines 🔗 Data Integration 🗄️ Databases 🤝 Collaboration 🔄 Automation 🔐 Security What we would love to see from you! 🎓 Education : Master’s in CS, Engineering, Mathematics, or related field 📊 Experience : Proven Data Engineer experience, preferably in finance 💻 Skills : Python, SQL, NoSQL, big data tools Cloud platforms (AWS, Azure more »

and Australia. It’s official: Bazaarvoice is a Great Place to Work in the US , Australia, India, Lithuania, France, Germany and the UK! Staff Data Engineer (P7) - Global Data Platform (Enablement) team What is the BV Data team at Bazaarvoice? Authentic data is the lifeblood … of the Bazaarvoice business. It is imperative that our data is consumable, interpretable, and instantly available to fuel insights across our brand, retailer and consumer customers. The BV Data team works closely with Product, Engineering, Business Development, and Account teams to consistently find new ways to use data across the business. Who We Want Are you ready to combine your talent for crafting solid data systems and enthusiasm for cutting-edge technology to harness the power of data at Bazaarvoice? We’re looking for a strong data engineer who thrives on building large more »

Data Engineer - Contract (Outside IR35) Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw data … department to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained Working … with an Agile delivery/DevOps methodology to deliver additional data products Delivering and presenting proofs of concept of key technology components to the wider data team and relevant stakeholders Essential Skills & Experience: Strong experience with SQL & Python Competent with designing and delivering solutions using Azure services Experience more »

Our client, an exciting start-up customer obsessed behavioural agency founded by two huge names in the data space (that have grown teams previously to 400+), is looking for a personable and hard-working Junior Data Engineer to design, build, and maintain a variety of solutions including … drive real business results, a stark contrast to the generic approaches often found at larger agencies. “Leading with Relationships and Results” As a Junior Data Engineer, you'll leverage your knowledge of data warehousing and Google Cloud Platform (GCP) to design and build data pipelines. You … ll combine your technical skills in data modelling and transformation with your expertise in cloud-based data services like BigQuery and Dataflow. What will you be doing? Data Engineering in Google BigQuery: Design, build, test, and deploy data models and transformations for efficient data analysis. more »

understanding of how people think, feel and act; globally and locally in over 90 markets. By combining the deep expertise of our people, our data resources and benchmarks and our innovative analytics and technology, we help our clients understand people and encourage growth. Backed by industry-leading anti-fraud … more than 100 markets worldwide. Our clients include many of leading brands, who trust us to collect reliable insights. Join Kantar Profiles as a Data Engineer, where your technical expertise and collaborative spirit will contribute to the success of our data-driven initiatives. Apply now and be … part of a team that is shaping the future of data analytics at Kantar Profiles. Job Summary As a Data Engineer at Kantar Profiles, you play a crucial role in the development and maintenance of robust data pipelines, facilitating seamless access to data for our more »

Job Title: Cloud Data Engineer Location: Knutsford, UK Hybrid work: 2-3 days a week Capgemini is seeking a Cloud Data Engineer t o join Capgemini Financial Services I&D Practice. This is a permanent, full-time position in Knutsford, UK and this represents a unique … opportunity for someone to enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data Build … Tool) for managing transformations in the data pipeline. Strong programming skills in technologies like Python, Scala, Spark, PySpark or Ab Initio, Glue, Starburst, Snowflake, Redshift, Starburst, Hybrid(on-prem to cloud) for building data pipelines and ETL processes. Experience with data pipeline orchestration tools like Apache Airflow more »

BettingJobs are working with an established sports betting odds provider who are based in London who are looking to add a Data Acquisition Engineer to their team. Responsibilities: Develop, test, run and monitor software that consumes data efficiently from approved sources. Ensure proper documentation is written and … date. Adopt and follow a good pace of software refactoring ensuring fast delivery of accurate data. Use internal tools to evaluate and validate all data acquired. Ensure all data shipped to the customers meets the quality standards. Quickly address customer issues following escalation from the Client Services Team … Keep learning and improving, sharing the acquired knowledge with the wider group. Maintain good relationships with wider Data Acquisition Team. Maintain clear and open path of communication with Client Services Team. Requirements: Coding proficiency preferably in Scala; alternatively Java, Python or any other high level language. A Bachelors degree more »

Lead Data Engineer A brand-new and exciting opportunity has arisen for a Lead Data Engineer with extensive experience in Azure, SQL, ETL and mentoring/managing engineers to join the UK's Largest Charity based remote. The Lead Data Engineer will be intrumental … in their migration over to Azure alongside installing best practises in the data engineering team. This is an excellent opportunity for a Lead Data Engineer who is looking to work for a rapidly not for profit organisation who are currently in the process of a huge cloud … migration and improving the data engineering function. If you are currently a Lead Data Engineer who has a strong experience in Azure (ADF, Databricks, Data Lake), SQL, ETL and mentoring/managing a team who is looking for a step up then this would be perfect more »

Data Engineer Salary: £59,479 - £66,100 (dependant on skills and experience ) Location: London UK About Us MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life. We carry out investigations by obtaining, analysing … limited and subject to business need. The Role Technology sits at the heart of everything we do at MI5. We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team. As a Data Engineer and working closely … with technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you’ll build and run secure data applications and data products. You’ll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to more »

Data Engineer Keynsham – Hybrid – 2 – 4 day in the office per month. Healthy animals and happy owners – that’s the goal. We are IVC Evidensia, and we are on a mission to build the world’s best veterinary group. Investing in people, premises and processes, we deliver outstanding … around 2,500 locations globally. IVC Evidensia is undergoing an exciting digital transformation. Key to this is to improve the management of our core data sets. This means accelerating the standardisation of operational systems in practices, the creation of stronger tools for managing master data and developing standard … reporting models across the group. We are currently looking for a Data Engineer who will be a technical authority accountable for the design and development of the technologies that underpin our data strategy. Primarily, this means orchestrating feeds of data from source systems to our group more »