designing, building, and optimising Big Data solutions to support the creation of highly scalable data stores with Big Data technologies such as Hadoop, Spark, Kafka, etc. Project experience in developing optimal and reliable ETL processes ingested from a wide variety of data sources both structured and unstructured and … AWS S3 or Google Cloud Platform. Ideally, you could also have… Project experience of message queueing and stream processing systems such as StreamSets, Spark-Streaming and Kafka. Project experience of data pipeline and workflow management tools. Exposure to any of the following technologies: Pega, Salesforce, RPA more »
and workflow management and their tools such as Airflow. Strong understanding of relational SQL and NoSQL databases, including MongoDB and stream-processing systems: Spark-Streaming, Kinesis etc. Ability to understand any scripting language and tools. Rewards & Benefits TCS is consistently voted a Top Employer in the more »
tools (EKS, EMR, Redshift, Postgres) Experience, or interest in orchestration and processing methods of large workloads using distributed data systems such as Airflow, Spark, Hadoop, and Trino Experience, or interest in processing real-time streaming workloads with distributed event systems such as Kafka, Kinesis, Google PubSub … Flink, or SparkStreaming What You Can Expect Interesting work - working in a fast-paced and ever-changing industry, new problems and exciting solutions are never too far away. There are always opportunities to learn new skills and broaden your horizons A sense of achievement - Our more »
expertise in tools like Informatica & Talend MDM Big data – Hadoop eco-system, Distributions like Cloudera/Hortonworks, Pig and HIVE Data processing frameworks – Spark & Sparkstreaming Hands-on experience with multiple databases like PostgreSQL, Snowflake, Oracle, MS SQL Server, NOSQL (HBase/Cassandra, MongoDB more »
Analytics in Azure Synapse Analytics, Azure Analysis Services Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and SparkStreaming, Azure EventHub/IoT Hub, and Azure Stream Analytics Experience with Object-oriented/object function scripting languages: Python preferred more »
