Senior Data Engineer – Level l

Beinex is looking for the best-in-class Data Engineer for its office at Kochi in Kerala.

Work with business requirements analysts to identify and solve business problems
Design and maintain cloud on-premises, and hybrid data platform architectures
Identify, design and implement full data warehouse and Big Data solutions
Design and maintain optimal data pipeline architectures for batch and real-time processing
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Come up with strategies for migrating from source systems to destinations (real time, batch and incremental)
Map source system data to data warehouse models
Develop and test extraction, transformation, and load (ETL) processes
Define and capture metadata and rules associated with ETL processes
Adapt ETL processes to accommodate changes in source systems and new business user requirements
Identify conflicting views or issues, and strive to identify the best solutions
Demonstrate extensive system/application knowledge; provide system/application support
Promote and demonstrate effective teamwork in an Agile team setting
Implement stored procedures and effectively query a database
Identify and test for bugs and bottlenecks in the ETL solution
Write advanced SQL, including some query tuning
Meet tight deadlines, deliver on time, and ensure high quality

Technical expertise regarding data models, database design development, data mining and segmentation techniques
Strong background knowledge in different database schema
Experience in Extraction, Transformation and Loading (ETL) development requirements gathering, analyzing, and documenting
Extensive experience with core Azure data cloud services: Data Factory, SQL DW, Azure Data Lake, Databricks
Experience with relational SQL and NoSQL databases, including some of the following: SQL DW, SQL Database and Snowflake
Experience with big data tools like Py Spark
Experience with data pipeline and workflow management tools: SSIS, Data Factory, Talend
Experience with stream-processing systems: Kafka, Azure Event Hub, Spark-Streaming.
DevOps / DataOps and CI / CD frameworks technology enthusiast preferred