Senior Data Engineer

Beinex is looking for the best-in-class Data Engineer for its office in Egypt.

Responsibilities

  • Work with business requirements analysts to identify and solve business problems
  • Design and maintain cloud on-premises, and hybrid data platform architectures
  • Identify, design and implement full data warehouse and Big Data solutions
  • Design and maintain optimal data pipeline architectures for batch and real-time processing
  • Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Come up with strategies for migrating from source systems to destinations (real time, batch and incremental)
  • Map source system data to data warehouse models
  • Develop and test extraction, transformation, and load (ETL) processes
  • Define and capture metadata and rules associated with ETL processes
  • Adapt ETL processes to accommodate changes in source systems and new business user requirements
  • Identify conflicting views or issues, and strive to identify the best solutions
  • Demonstrate extensive system/application knowledge; provide system/application support
  • Promote and demonstrate effective teamwork in an Agile team setting
  • Implement stored procedures and effectively query a database
  • Identify and test for bugs and bottlenecks in the ETL solution
  • Write advanced SQL, including some query tuning
  • Meet tight deadlines, deliver on time, and ensure high quality

Key Skills required

  • Technical expertise regarding data models, database design development, data mining and segmentation techniques
  • Strong background knowledge in different database schema
  • Experience in Extraction, Transformation and Loading (ETL) development requirements gathering, analyzing, and documenting.
  • Extensive experience with core Azure data cloud services: Data Factory, SQL DW, Azure Data Lake, Analysis Services, Databricks
  • Experience with relational SQL and NoSQL databases, including some of the following: SQL DW, SQL Database, SQL Server, Cosmos DB, and Snowflake
  • Experience with big data tools: Hadoop, Py Spark, Databricks
  • Experience with data pipeline and workflow management tools: SSIS, Data Factory, Talend, Informatica
  • Experience with stream-processing systems: Kafka, Azure Event Hub, Apache NiFi, Storm, Spark-Streaming.
  • DevOps / DataOps and CI / CD frameworks technology enthusiast preferred
  • Communication skill in Arabic preferred
  • Designation:Senior Data Engineer
  • Location:Egypt
  • Job Type:Full Time, Permanent
  • Department:Analytics
  • Qualification:Any Graduation
  • Joining Date:Immediate or Max 30 days Notice Period
  • Experience:5+ Years
  • Company Profile: www.beinex.com
  • Email: careers@beinex.com

    Apply for this position