Address

USA
633, West 5th Street, Los Angeles, CA 90071, USA

INDIA
3, Nehru Nagar, Nagpur, MS 440015

Azure Data Engineer

Jump start your career with us

As an Azure Data Engineer


Azure Sr. Data Engineer


Full time

Nagpur, IN

Job Description

As an Azure Sr. Data Engineer, you will solve some of the most impactful business problems for our clients using a variety of Azure services. You will collaborate with business partners and domain experts to design and develop innovative solutions with the models to achieve predefined outcomes.


Responsibilities

  • Collect and ingest data from various sources into Azure, such as databases, streaming platforms, logs, APIs, and external data providers.
  • Design and manage data storage solutions on Azure, including data lakes, data warehouses, and NoSQL databases like Azure Data Factory, Azure Data Lake, Azure Databricks, and others.
  • Implement ETL (Extract, Transform, Load) processes to clean, transform, and enrich raw data into a format suitable for analysis and reporting.
  • Implement ETL (Extract, Transform, Load) processes to clean, transform, and enrich raw data into a format suitable for analysis and reporting.
  • Ensure data security and compliance with Azure security best practices by configuring access controls, encryption, and monitoring.
  • Implement data quality checks, data profiling, and data governance practices to maintain data accuracy and consistency.
  • Monitor and optimize data pipelines and storage solutions for performance, scalability, and cost-effectiveness.
  • Build real-time data processing solutions using Azure services.



Requirements

  • BE/B-Tech/MTech
  • 5+ years of work experience with ETL, Data Modelling, and/or Data Architecture.
  • Azure/AWS data factory, Logic apps, API management, MySQL
  • Experience in Database engineering and refactoring, with ETL using AWS data factory.
  • Experience with Data warehouse development and maintenance with AWS Synapse Database.
  • Proficiency in SQL and experience with different database systems, including relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
  • Extensive Pipeline development using Azure Data Factory and Databricks including exposure to Cloud functions
  • Translate business requirements to technical specs and execute
  • Good communication skills and soft skills for team/stakeholder management.