InetumInetum

Big Data Engineer

Added 2 months ago

Description

Inetum is seeking a seasoned Big Data Engineer to join our team and support the operations of our Hadoop-based data lake environments. This is a critical role for ensuring the performance, reliability, and security of our big data infrastructure.

Key Responsibilities

  • Operate, monitor, and support Hadoop-based data lake platforms.
  • Provide L3 incident response, deep troubleshooting, and performance tuning for big data components.
  • Ensure data integrity, replication, and capacity management within HDFS clusters.
  • Develop and automate monitoring and alerting for service health and node performance.
  • Collaborate with platform and data teams to onboard new workloads with optimal resource allocation.
  • Apply patches, upgrades, and configuration changes to maintain platform security and stability.
  • Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption.
  • Work with storage, network, and security teams to optimize throughput and access controls.
  • Maintain cluster documentation and share knowledge across teams.

Qualifications

  • Bachelor’s degree in Computer Science or equivalent.
  • Minimum 5 years of experience in a similar role.
  • Strong expertise in:
    • Hadoop Ecosystem & Data Lake Operations
    • Big Data Services & Query Engines
    • Security & Access Control in Distributed Environments
    • Monitoring, Automation & Platform Lifecycle Management
  • Proven ability to diagnose and resolve complex issues in Big Data environments.
  • Strong communication skills to collaborate with cross-functional teams.
  • English proficiency: B2-C1 level

Company

Inetum helps public and private organizations navigate digital transformation with consulting, technology, and solutions across industries, supported by a global delivery model and AI focus.

See more big data engineer jobs in Lisbon, Portugal