Role Overview

We are seeking a seasoned Data Engineering & Analytics Architect with 15+ years of experience to lead and solutionize large-scale data modernization projects. This role demands a strategic thinker and hands-on practitioner who can design, architect, and deliver cutting-edge data solutions on the Azure platform. The ideal candidate will have strong leadership capabilities, a deep understanding of data architectures, and the ability to integrate AI-driven insights into data platforms.

Key Responsibilities

Leadership & Strategy

• Act as the primary advisor to customers, understanding their problem statements and recommending tailored strategies for data modernization and analytics.
• Lead cross-functional teams to design and implement scalable data platforms that align with business objectives.
• Drive discussions with executive stakeholders to ensure alignment of solutions with organizational goals.
• Mentor and coach teams on best practices, emerging trends, and new technologies in data engineering and analytics.
• Manage stakeholder expectations by communicating technical solutions in business terms and ensuring project delivery meets deadlines and budgets.

Solution Design & Architecture

• Architect end-to-end data solutions on the Azure platform, including data lakes, warehouses, and real-time analytics.
• Develop enterprise-grade data models, schemas, and frameworks to support ingestion, transformation, and advanced analytics.
• Define and implement scalable, secure, and high-performance architectures using Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, and Azure SQL Data Warehouse.
• Integrate AI capabilities into the data ecosystem, leveraging tools such as Azure Machine Learning, Databricks, and Cognitive Services for advanced analytics and insights.
• Ensure robust data governance, compliance, and security practices are embedded in all designs.

Implementation & Optimization

• Lead the development of ETL/ELT pipelines for large-scale data processing, transformation, and storage.
• Optimize data pipelines, queries, and infrastructure to ensure reliability, scalability, and performance.
• Automate data quality checks and validations to maintain high data integrity.
• Monitor, troubleshoot, and resolve issues across data platforms.

AI & Advanced Analytics

• Implement machine learning pipelines for predictive and prescriptive analytics using Azure Machine Learning and Databricks.
• Leverage Azure Cognitive Services to enable AI-powered functionalities such as natural language processing (NLP) and computer vision within data platforms.
• Drive the adoption of AI-based anomaly detection, forecasting, and recommendation systems within the data ecosystem.

Collaboration & Documentation

• Work closely with business stakeholders, analysts, and engineers to ensure alignment of solutions with business goals.
• Document all technical designs, including data architectures, data flows, and system integrations.
• Create and maintain comprehensive documentation such as system diagrams, data dictionaries, and operational playbooks to ensure maintainability and scalability.

Required Skills & Experience

• Data Architecture: Expertise in designing and implementing enterprise-scale data solutions using Azure services (Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Databricks).
• AI & Machine Learning: Experience with AI frameworks and platforms such as TensorFlow, PyTorch, Azure Machine Learning, and Cognitive Services.
• Data Engineering: Strong experience in ETL/ELT processes, data modeling, and data pipeline optimization.
• Cloud Expertise: Deep knowledge of Azure platform services, including cost optimization, scalability, and security best practices.
• Programming: Proficiency in Python, SQL, Spark, and other programming languages relevant to data engineering and AI.
• Leadership: Proven ability to lead large-scale projects, mentor teams, and manage stakeholder relationships.
• Compliance & Governance: Strong understanding of data compliance (GDPR, HIPAA, etc.) and governance practices.
• Tools: Hands-on experience with BI tools like Power BI, Tableau, and integration platforms such as Logic Apps or API Management.

Why Join Programmers.io?

Programmers.io is a global technology services company with a focus on empowering clients through cutting-edge solutions in data engineering, cloud transformation, and AI/ML. With a workforce of over 1,000 talented professionals and a strong commitment to growth, we provide a collaborative, innovation-driven environment. Join us to work on large-scale, impactful projects with top-tier clients worldwide.
Locations: Hyderabad or Jaipur, India (with flexible hybrid work model).