knowledge in SQL and relational databases (e.g., Microsoft SQL Server, Oracle). Big Data Technologies: Familiarity with big data technologies such as Hadoop, Spark, or Kafka is a plus. Data Warehousing: Experience in data warehousing, including data modeling and implementing data pipelines. Data Management: Multi-skilled experience in … integration. Familiarity with NoSQL databases or cloud-based data platforms such as Snowflake. Experience with message queueing and stream processing systems such as Spark-Streaming and Kafka. Working knowledge of data visualization tools such as Power BI or Tableau. Capability to articulate and document architectural solutions more »
Peterborough, England, United Kingdom Hybrid / WFH Options
Tata Consultancy Services
of data pipeline and workflow management tools like Airflow. Experience with relational SQL and NoSQL databases, including MongoDB. Experience with stream-processing systems: Spark-Streaming, Kinesis etc. Effective communication and stakeholder management skills. Good to have: Agile project experience working in scrums. Experience in Databricks. Rewards more »
ETL processes to ingest and transform data.Design and develop end-to-end analytics solutions using big data batch and stream processing frameworks (e.g., Spark Structured Streaming, Kafka, etc.) and large language models (LLMs).Build and train machine learning models and utilize large language models.Help mentor and … Data Engineer Professional or equivalent hands-on experience.Five-plus years of programming experience with Python and SQL.Five-plus years of experience with ApacheSpark for data processing.Five-plus years of experience building large-scale data pipelines with Apache Kafka and Spark stream processing.Three-plus years of more »