3 AWS Data Pipeline Jobs

𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫 - 𝐌𝐚𝐜𝐫𝐨 𝐇𝐞𝐝𝐠𝐞 𝐅𝐮𝐧𝐝 - 𝐋𝐨𝐧𝐝𝐨𝐧 - 𝐔𝐩 𝐭𝐨 £𝟏𝟓𝟎𝐤 + 𝐁𝐨𝐧𝐮𝐬 Note: I have a plethora of live Data Engineering opportunities. Therefore, even if you don't feel your profile is relevant for the role mentioned below, we encourage you to apply anyway to discuss one of the … other positions. A well established Quant Fund we are working with is looking to develop a new high frequency data platform to support the development and deployment of new strategies. The sort of work you would get exposure to includes: building greenfield market data processing systems … that will handle very large amounts of market/exchange data, data lake development using AWS Glue, Apache Kafka/Airflow and dbt, and more traditional end-to-end Data Pipeline development. Lastly, part of this role would look at more »

New 1 year contract opportunity for a mid-senior (outside IR35) Data Engineer to join an independent Civil Society with immediate effect. Data Engineer Responsibilities Design and implement scalable data architectures for large-scale web-scraping tools. Develop and optimize data pipelines … for ETL from online platforms, including textual and unstructured data, and REST APIs. Test, validate, and secure acquired data to ensure accuracy and quality. Work closely with the AI/ML Engineer to ensure seamless integration and alignment of data and AI models. Data Engineer Required Experience Data engineering experience (2+ years) Cloud platform proficiency (e.g., AWS, Azure, GCP) Data pipeline development (e.g., Airflow, Apache Spark) SQL proficiency, database design Visualization tools knowledge (e.g., Tableau, PowerBI, Looker) Data Engineer Application Process This more »

in the resolution of complex user requests and ensuring a minimum of the agreed service level agreements. Maintain confidentiality in accordance with our data protection policies and procedures. Delivering to service quality KPI's that underpin the management of Masteks services Demonstrate knowledge of the specific technologies necessary … a workplace environment MANDATORY A detailed understanding of tooling across the service spectrum (Jira, ServiceNow, Splunk/Dynatrace/Grafana/Cloudwatch/AWS/Github/secure pipelines etc.) Proven experience as an L2 Engineer, Technical Support Engineer, or similar role in a technical environment. Strong proficiency … in troubleshooting and resolving technical issues in software applications, systems, and networks. Knowledge of programming languages Java, JVM, DynamoDB, AWS IAM, CloudWatch, PagerDuty, Tooling TypeScript, Node.js, SRE, AWS Data Pipeline & Visualisation and scripting is a plus. Excellent problem-solving skills with the more »