Description
We are seeking a Data Engineer with strong AWS expertise to design, develop, and implement data pipelines and integrations for ingesting and processing data from various IWMS platforms into AWS RDS. This role requires expertise in building scalable, secure, and resilient data ingestion solutions using AWS-native services, along with the ability to create custom integration adapters using web services and serverless functions.
The ideal candidate will enforce industry best practices for data auditing, error handling, security (including Row-Level Security), and operational monitoring to ensure future production stability and data integrity.
Key Responsibilities:
Design and build data pipelines to extract, transform, and load (ETL) data from IWMS systems (e.g., TRIRIGA, ARCHIBUS, Planon) into AWS RDS
Develop integration adapters using Web Services and custom functions leveraging Java or Python, as needed
Utilize AWS services such as Lambda, Glue, Step Functions, S3, and others for data processing and orchestration
Develop frameworks for batch and near real-time data ingestion, integrating with external and internal systems
Implement industry best practices for data ingestion, auditing, error handling, Row-Level Security (RLS), and operational logging
Ensure data accuracy, consistency, security, and traceability across all data pipelines and processes
Collaborate with business analysts, product teams, and technical stakeholders to define data mapping, transformation logic, and integration specifications
Proactively troubleshoot, optimize, and tune data workflows for performance, scalability, and reliability
Enforce data security, compliance, and governance standards within all integration and data pipeline solutions
Company
GQI focuses on growth strategy, leadership transformation, and market expansion, offering strategic advisory and decision-support via the GQI Platform. The platform combines real-time data, market trackers, customizable dashboards, analytics, and expert reports to deliver actionable insights. Its intelligence is described as quantum- and AI-powered, designed for vendors, innovators, end-users, investors, and governments.
Related postings
PradeepIT Global Consulting Pvt Ltd
AWS Data EngineerIndiaPradeepIT Global Consulting Pvt Ltd
AWS Data EngineerIndiaWeekday
AWS Data EngineerIndia and 2 othersMactores
AWS Data Engineer (Senior)India