Job DescriptionThis role is responsible for the development and implementation of data warehouse solutions for company-wide application and managing large sets of structured and unstructured data.

• The candidate will be expected to analyze complex customer requirements and work with data warehouse architect to gather, define and document data transformation rules and its implementation.


• Data Engineers will be expected to have a broad understanding of the data acquisition and integration space and be able to weigh the pros and cons of different architectures and approaches.


• You will have a chance to learn and work with multiple technologies and Thought Leaders in the domain.

Responsibility

• Translate the business requirements into technical requirements


• ETL development using native and 3rd party tools and utilities


• Write and optimize complex SQL and shell scripts


• Design and develop code, scripts, and data pipelines that leverage structured and unstructured data


• Data ingestion pipelines and ETL processing, including low-latency data acquisition and stream processing


• Design and develop processes/procedures for integration of data warehouse solutions in an operative IT environment.


• Monitoring performance and advising any necessary configurations & infrastructure changes.


• Create and maintain technical documentation that is required in supporting solutions.


• Coordinate with customers to understand their requirements


• Provide direct support to the project lead and the solution delivery team.


• Readiness to travel to customer sites for short, medium or long-term engagements.

Skills And Qualifications

• S. / M.S. in Computer Sciences or related field


• Hands on experience with one or more ETL tools like Informatica, DataStage, Talend etc.


• Strong concepts of designing and developing ETL architectures.


• Strong RDBMS concepts and SQL development skills


• Good understanding of data modeling and mapping


• Experience with Data Integration from multiple data sources


• Working experience in one or more business areas like Telecom, Retail, Finance etc.


• Good knowledge of Big Data technologies such as Pig, Hive, Spark, Kafka, Nifi


• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB


• Experience with any of the Hadoop distributions such as Cloudera/Hortonworks


• Working experience with at least one cloud service provider AWS, Azure or Google Cloud and hands on with their native tools.


• Experience in projects using Agile delivery is mandatory.


• Solid understanding of DevOps technology stack and standard tools/practices like Linux, Dockers, Jenkins & Git etc.


• Experience with Teradata tools and technologies will be a plus.


• Training/Certification on Teradata will be a plus.


• Good communication and presentation skills, both verbal and written


• Proven experience in customer facing roles for large engagements and experience in working with delivery teams.


• Ability to solve problems using a creative and logical mind set


• Must be self-motivated, analytical, detail oriented, organized and pursue excellence on all tasks