LingaroLingaro

Data Engineering Architect

Added 2 months ago

Description

1

Tasks:

  • Acting as a Senior Consultant/Solution Advisor:

  • Technology partner: Advise on designing data architectures in Microsoft Azure.

  • Empowering customer to spot and leverage business opportunities by unlocking the power of data. 

  • Providing technical and problem-solving expertise for client representatives and Lingaro project teams. 

  • Data Integration: Lead data integration efforts, including ETL processes, to ensure seamless data flow. 

  • Cloud Services Utilization: Leverage Azure, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions. 

  • Advise on security measures and compliance standards in cloud environments. 

  • Continuously monitor and optimize data solutions for cost-efficiency. 

  • Data Governance: Advise data governance and quality standards. 

  • Collaboration: Work with cross-functional teams to understand requirements and provide data solutions. 

  • Mentoring junior team members in cloud data architecture best practices. 

  • Daily tasks including:

  • implementing data ingestion pipelines from multiple data sources using Azure Data Factory, Azure Databricks and other ETL tools.

  • developing scalable and re-usable, self-service frameworks for data ingestion and processing.

  • designing, building, and managing SQL server databases in the Azure cloud.

  • performing data modelling and integrating data from various systems

  • reviewing and implementing best practices for data manipulation

  • creating and supporting Azure Data Factory pipelines.

  • Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data.

What we are looking for:

  • 11+ years of professional experience in the Data & Analytics area, 
  • 5+ years of experience in the Senior Consultant role with a strong focus on Azure data solutions
  • Advanced knowledge and understanding of architecture, application design, systems engineering, and integration. 
  • Very good knowledge of cloud data services, data warehousing, big data technologies, and data lakes. Especially Azure, DataBricks
  • Expertise in data modeling, data integration, and ETL processes. 
  • Proven experience in using of Microsoft ETL tools (Azure Databricks, Azure Data Factory, Data Lake and SSIS)
  •  Databricks Unity Catalog, Asset Bundles, Data Factory, Microsoft Fabric. Logic App, Function App.
  • Programming skills for data analysis (especially PySpark, SparkSQL, Python, SQL)
  • Familiarity with data governance, data security, and compliance standards. 
  • Familiarity with agile methodologies and the ability to apply DevOps and DataOps principles to data pipelines. 
  • Ability to use ARM templates
  • Experience in working with JSON
  • Good understanding of business processes and the ability to drive automation through effective management. 
  • This role involves designing the project architecture. Setup, monitoring Internal Developer Platform. UC migration. Building Databricks Asset Bundles. PR reviews. Data Model / Semantic Layer setup.  Model QA automation.

 

What we offer:

  • Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
  • “Office as an option” model. You can choose to work remotely or in the office, depending on your location.  
  • Flexibility regarding working hours and your preferred form of contract.  
  • Comprehensive online onboarding program with a “Buddy” from day 1.   
  • Cooperation with top-tier engineers and experts.  
  • Unlimited access to the Udemy learning platform from day 1.
  • Certificate training programs. Lingarians earn 500+ technology certificates yearly. 
  • Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
  • Internal Gallup Certified Strengths Coach to support your growth.
  • Grow as we grow as a company. 76% of our managers are internal promotions.  
  • A diverse, inclusive, and values-driven community.   
  • Autonomy to choose the way you work. We trust your ideas.  
  • Create our community together. Refer your friends to receive bonuses.  
  • Activities to support your well-being and health.
  • Plenty of opportunities to donate to charities and support the environment.  
  • Modern office equipment. Purchased for you or available to borrow, depending on your location

Company

Lingaro positions itself as an end-to-end data services partner, delivering capabilities across data strategy, management, transformation, analytics, AI and adoption to help clients achieve cloud cost savings, data-enabled revenue growth and large-scale data operations.

See more data engineering architect jobs in India + remote