Company Name: TATA Technologies
Job Role: Data Engineer
Experience: 4 – 9 Years
Qualification: Any Graduate / Any Post Graduate
Job Type: Full Time
Job Location: Bangalore, Chennai
Salary: Best in Industry
Job Description:
Responsibilities:
- Build data systems and pipelines
- Standardize the data assets which maximize data reusability
- Evaluate business needs and objectives
- Implementing data pipeline to ingest and cleanse raw data from various source systems including SaaS, Cloud based and On-prep databases
- Conduct complex data analysis and report on results
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Implementing functional requirements including incremental loads, data snapshots and identity resolution
- Optimizing data pipelines to improve performance and cost, while ensuring a high quality of data within the data lake:
- Monitoring services and jobs for cost and performance, ensuring continual operations of data pipelines, and fixing of defects.
- Constantly looking for opportunities to optimize data pipelines to improve performance.
Experience and Skills Sets required:
- Minimum 4-8 years of experience
- Good coding skills in Spark/Pyspark, Python and SQL
- Good Knowledge of AWS tools, Glue, Redshift , Athena and S3
- Good knowledge of CI/CD (Github / Github Actions, Terraform)
- JIRA
Walk-in Details:
Walk-in Date: 30th November 2024
Time: 9.30 AM – 3.00 PM
Venue Details:
Tata Technologies, Survey No. 58,
Pvt Ltd, Aurbis Business Parks,
THE PAVILION SJR PRIME, 7, Outer Ring Rd,
Devarabisanahalli, Bellandur,
Bengaluru, Karnataka 560103.