1. Senior Data Engineer

Preferred Experience: 6+ years

Role Summary

We are seeking a Senior Data Engineer to design and develop scalable data solutions using Microsoft and Azure technologies. The candidate will work on data architecture, integrations, pipelines, database development, production deployments, and technical leadership.

Key Responsibilities

• Design and maintain enterprise data architectures, data models, and reliable data pipelines.

• Develop complex SQL queries, stored procedures, and database solutions.

• Build integrations using Azure Data Factory, Logic Apps, Synapse, and Microsoft Fabric.

• Support deployments, performance monitoring, troubleshooting, and technical documentation.

• Guide junior engineers and promote engineering, security, and DevOps best practices.

Required Skills

• Strong SQL, database architecture, data modeling, and stored procedure experience.

• Hands-on experience with Azure Data Factory, Logic Apps, Synapse, or Microsoft Fabric.

• Working knowledge of C#, Entity Framework, APIs, Docker, Splunk, and deployment processes.

• Experience with cloud-based data platforms, CI/CD, monitoring, and production support.

Technical Screening Questions

1. How would you design an Azure data pipeline that ingests data from multiple sources, supports incremental loads, and prevents duplicate records?

2. Describe a complex SQL performance issue you resolved. How did you identify the bottleneck, and what changes did you make?

3. When would you choose Azure Data Factory, Synapse pipelines, Logic Apps, or Microsoft Fabric for an integration or orchestration requirement?

4. How do you implement data quality checks, error handling, retries, and alerting in a production data pipeline?

5. Explain how you would structure a CI/CD process for database objects, data pipelines, and configuration changes across environments.