Senior Software Engineer
1 year ago Public Service Hyderabad 85 views Reference: 33321Job Details
5+ years of experience in a Data Engineer or equivalent role in enterprise initiatives
§ 3+ years in Python, Spark
§ 1+ year of experience in Snowflake
§ 3+ years of experience in working with SQL databases, Transaction replication and Change data capture technologies.
§ Experience building processes to support data transformation, data structures, metadata, dependencies, and workload management.
§ Experience CI/CD workflows
Responsibilities:
• Extract source data from internal data exchange system.
• Design and build the data Ingestion. Pipeline using Python and Spark.
• Understand source data, do minimal data profiling and data mapping.
• Load transformed data into snowflake datawarehouse (not a dimensional model).
• Automate job scheduling through Airflow.
• Create CICD pipelines (nice to have).
• Participate in code reviews, quality assurance and documentation reviews.
Interested can share [***]
Company Description
In 2012, Wipro demerged its non-IT businesses into a separate company called Wipro Enterprises.[12][13][14] Prior to this demerger, these businesses, mainly in the consumer care, lighting, furniture, hydraulics, water treatment, and medical diagnostics, contributed about 10% of Wipro's total revenues.[15][16][17]
In March 2023, Wipro opened its American international Headquarters at Tower Center in East Brunswick, Middlesex County, New Jersey.[1]