The Cluster Specialist/Hadoop Developer will be responsible for the firms Hadoop clusters and executing high performance computing projects to add value for various functions and trading teams.
3 + years of experience working with big data in a Hadoop environment.
5+ years hands-on experience with supporting Linux production environments.
Experience work with HDFS, YARN, Hive, Pig, Oozie, Slider, Sqoop etc..
Scripting experience in Python, Bash or other similar.
Experience with automation and monitoring software such as SaltStack, Puppet, Nagios, Zabbix etc…
Experience of using Spark, Kafka, SALT, and Puppet