Hadoop Developer

The Data Services team develops and maintains the next generation data platform used by Macquarie’s trading businesses and their support functions (finance, operations and risk). The team is looking for an experienced Big Data Engineer to help develop and support the platform. This a great opportunity for an experienced Hadoop developer and/or administrator to join a growing team, work with cutting edge technologies and influence the direction taken by the platform.

This role will participate in and be responsible for:

  • design and implementation of data pipelines in Hadoop
  • ongoing management and support of the Cloudera/Hadoop platform including capacity management, performance monitoring, user administration, troubleshooting and resolution of technical issues
  • help define and document the platform’s architectural principles, development standards and operational processes
  • provide technical support and guidance to users of the platform.

Key skills requirements:

  • commercial Hadoop development and/or administration experience
  • experience with building stream-processing systems, using solutions such as Storm or Spark Streaming
  • good knowledge of Hadoop querying tools, such as Hive, and Impala
  • experience with MapReduce or Spark
  • experience with NoSQL databases, such as HBase or MarkLogic
  • knowledge of various ETL techniques and frameworks, such as Flume
  • excellent problem-solving skills
  • excellent communication skills.

Bonus points for:

  • cloudera, AWS and/or Splunk experience
  • knowledge of reporting tools such as Tableau and PowerBI
  • experience in the financial services industry and derivative trading in particular
  • experience with Agile methodologies
  • experience working with distributed teams.

If you are interested in this position, please apply via the following link. For more information please reach out to Chirag Bhojani by email to chirag.bhojani@macquarie.com

The Corporate Operations Group (COG) brings together specialist support services including workplace, human resources, market operations and technology. COG's purpose is to drive operational excellence through business-aligned services with a focus on quality, cost and risk. COG comprises the following divisions: Business Improvement and Strategy, Business Services, Human Resources, Market Operations, and Technology.

Find out more about Macquarie careers at www.macquarie.com/careers 

Macquarie understands the importance of diversity and inclusion - our long history of success has come from being different. At Macquarie we value the innovation and creativity that diversity of thought brings. The one thing we all have in common is our focus on high performance. If you are capable, motivated and can deliver, we want you on our team.

We facilitate a range of flexible working arrangements within our teams. Talk to us about what flexibility may be available. Our Technology Returner program is an opportunity for you to re-integrate yourself into the workforce following an extended professional career break. Find out more and apply at https://www.macquarie.com/au/about/careers/jobs/returner-program

Are you viewing this job on LinkedIn? Click here to apply