Job Description
Req ID: 365801
We are currently seeking a Senior Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).
Job Duties: Given the input from the Data Scientist and Data Modeler, create the data pipeline to ingest, cleanse and standardize the data so that it can be ready for analysis.
Once the data is processed, apply the machine learning algorithm as prescribed by the Data Scientist with the production performance readiness. Finally, once the result is processed, activate the models through either Micro Services, Rporting, Dashboard, or emails
• Experience with Big Data Technologies or Cloud Technologies building data
pipelines
• DevOPs Experience (source control, continuous integration, deployments, etc.)
• Experience with containerization and related technologies (e.g. Docker, Kubernetes)
• Experience in other open-sources like Druid, Elastic Search, Logstash etc
• Advanced knowledge of the Hadoop ec...