Senior Data Developer
We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.
With over 8,000 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.
You will be responsible for evaluating, designing, building, and maintaining complex data solutions at scale. You will work in partnership with product, technology, and business leaders to define the appropriate architectural mechanisms, ensuring the development of scalable, reliable, and high-performance solutions.
Responsibilities:
- Design and Develop Data Pipelines: Architect, implement, and maintain scalable and high-performance ETL/ELT pipelines to process large volumes of structured and unstructured data.
- Data Integration and Processing: Build event-driven architectures to enable real-time data processing and seamless integration between systems.
- Cloud Infrastructure Management: Leverage cloud services to design and deploy a robust data infrastructure.
- Code Development and Optimization: Write clean, efficient, and maintainable Python code to support data ingestion, transformation, and orchestration.
- Agile Collaboration: Work closely with cross-functional teams, including data scientists, analysts, and software engineers, following agile methodologies to deliver iterative solutions.
- Data Quality and Governance: Implement best practices for data quality, monitoring, and compliance to ensure data integrity, consistency, and security.
- Performance Optimization: Optimize data pipelines and queries in cloud environments for performance, scalability, and cost efficiency.
- Mentoring and Leadership: Provide technical guidance to junior team members, fostering a culture of continuous learning and improvement.
- Documentation and Knowledge Sharing: Document technical designs, processes, and workflows to ensure knowledge maintenance and transfer.
Requirements for this challenge:
- Professional experience as a Data Engineer or similar role, with a strong focus on developing data pipelines and cloud-based data solutions.
- Advanced proficiency in Python for data processing, scripting, and automation.
- Hands-on experience with Databricks or Snowflake for high-volume data processing.
- Expertise in designing and implementing ETL/ELT workflows using tools such as Apache Airflow, AWS Glue, or similar.
- Experience building real-time data pipelines using event-driven frameworks.
- Experience with agile methodologies such as Scrum or Kanban.
- Proficiency in relational and non-relational databases, with expertise in SQL optimization.
- Solid understanding of data modeling techniques for analysis and reporting.
- Familiarity with CI/CD pipelines, version control, and infrastructure as code.
- Exceptional analytical skills focused on delivering scalable and efficient solutions.
- Excellent verbal and written communication skills, with the ability to collaborate effectively with technical and non-technical stakeholders.
Nice to have:
- Experience with containerization technologies (e.g., Docker, Kubernetes) for deploying data applications.
- Knowledge of data governance frameworks and compliance standards (e.g., GDPR, CCPA).
- AWS, Azure, Snowflake or Databricks certifications.
#LI-JP3
Our benefits:
-Health and dental insurance
-Meal and food allowance
-Childcare assistance
-Extended paternity leave
-Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
-Profit Sharing and Results Participation (PLR);
-Life insurance
-Continuous learning platform (CI&T University);
-Discount club
-Free online platform dedicated to physical, mental, and overall well-being
-Pregnancy and responsible parenting course
-Partnerships with online learning platforms
-Language learning platform
And many more!
More details about our benefits here: https://ciandt.com/br/pt-br/carreiras
At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. See which data needs to be included in the report by clicking here.This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don't worry: we can support you in obtaining it.
We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.