Senior Big Data / Hadoop / Linux Administrator – Threat Defence Unit

Logic Bounce is an independent research-driven and insight-led security consultancy founded in 2013 with offices in Europe, Asia and North America. In a rapidly changing technology landscape, innovation is essential and we believe passionately that the surest way to run out of new ideas is to hold too tightly onto old ones. In an era of digital disruption and transformation, cybersecurity is the essential component that ensures that companies have the confidence to implement digital processes and technologies to drive innovation and growth. We offer a complete portfolio of services to help identify threats and risks, define strategy, deploy the right technologies, develop capabilities and ensure operational readiness to enable business through security. We have the ability to address the needs at a strategic program level, at the operational project level and at all levels in between.

Role Overview

Logic Bounce is seeking a Senior Hadoop Administrator to join our Big Data team.  Our team is responsible for managing the infrastructure and building the software which currently ingests and enriches billions of security events per day, exposing data for search, forensic investigation, analytics, and data-science purposes.

The role is founded in Linux systems administration and Hadoop enterprise administration experience. This position is responsible for our distributed data processing clusters’ day-to-day operational support as well as participation in large-scale infrastructure projects and initiatives.

This position participates in an active team on-call rotation, which is vital to maintaining acceptable levels of service delivery for clients.

Role Responsibilities

• Work on day-to-day operational support of our Cloudera Hadoop clusters in lab and production environments, operating at multi-petabyte scale.
• Deploy and manage common widely used services throughout the Hadoop ecosystem.
• Provide input to major architectural designs to ensure consistency, security, maintainability and flexibility with respect to overall system architectures.
• Collaborate with Product Management, IT Architecture, and Engineering to review software enhancements and provide design feedback.
• Make recommendations to improve process efficiency and effectiveness.
• Train and mentor Logic Bounce operational personnel on supporting our clusters.
• Respond to health alerts generated by Cloudera Manager and Nagios.
• Respond to emergency incidents and standard support requests, working them through to completion within established SLA.
• Collaborate with multiple internal teams to resolve incidents and support requests.
• Improve tools and scripts that automate routine tasks and monitor system health.
• Participate in an active on-call rotation to provide after-hours response for critical service delivery incidents.

Logic Bounce expects its employees to understand and apply commonly known security practices and possess a working knowledge of applicable industry controls such as NIST 800-53. Employees will be expected to acknowledge their security responsibilities in writing prior to gaining access to company systems. Employees will be required to maintain a working knowledge of local security policies and execute general controls as assigned.
Limited travel when required

Qualifications

• 2+ years Hadoop / Big-Data experience
• 5+ years Linux Administration experience preferred
• Experience supporting an enterprise distributed data processing platform, or equivalent training.
• Operational experience (management and monitoring) with at least one of the following Hadoop distributions:
  • Cloudera CDH and Cloudera Manager
  • Hortonworks HDP and Ambari
  • AWS EMR
  • MAPR
• Operational experience (management and monitoring) with Lucene-based distributions:
  • Elasticsearch
  • Solr
• Experience with automation tools, as well as scripting languages such as Bash, Perl, Python.
• Ability to:
  • Troubleshoot common problems with Hadoop core services (HDFS, YARN, etc.) and ecosystem projects (Spark, Hive, Impala, MapReduce, etc.)
  • Work effectively with our vendor support to diagnose complex issues, apply patches, updates, etc.
• Strong working knowledge of:
  • TCP/IP networking concepts, including subnets and routing
  • Information security principles
  • Linux (Red Hat 6/7), user commands, and administrative tools, including Satellite
• RedHat certification – RHCSA or RHSE – or equivalent Red Hat Linux experience.
• Hadoop certification – HDPCA or CCAH – or equivalent administration experience.
• Good oral and written communication skills, combining attention to detail with the ability to present technical findings to a business audience
• Excellent client service skills including the ability to take ownership of escalated issues, provide clear and consistent updates, and work with various internal teams until issues are fully resolved.

Logic Bounce is committed to the principle of equal employment opportunities for all employees and to provide employees with a work environment free of discrimination and harassment. All employment decisions at Logic Bounce are based on business needs, job requirements and individual qualifications, without regard to race, colour, religion or belief, national, social or ethnic origin, sex, age physical, mental or sensory disability, sexual orientation, gender identity and/or expression, martial, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status or any other status protected by the laws or regulations in the locations where we operate. Logic Bounce will not tolerate discrimination or harassment based on any of these characteristics. Logic Bounce encourages applicants of all ages.