Jobs | Gigaom | The industry leader in emerging technology research
Data Engineer (Sr.) - (Sr.) Big Data Developer Posted Oct 21
Nigel Frank - Churchill Frank , München, Bayern, Germany
 
  • This employer requests that only candidates in Germany apply to this job.

    You appear to be located in United States, not Germany, so you will not be able to apply for this job.

Brand new opportunity has arisen for a (Sr.) Data Engineer to join my client in Munich. This in house role is based with a huge international client of mine and is ideal for a DevOps person with preferably 2 3 years experience with Cloudera distribution of Hadoop. You will be closely working with IT architects to elicit requirements, to optimize the system performance as well as to advance its technological foundation. Respobsibilities: Manage very large scale, multi tenant and secure, highly available Hadoop infrastructure Provide architectural guidance, planning, estimating cluster capacity creating roadmaps for Hadoop cluster deployment Install Hadoop distributions, updates, patches, version upgrades Design, implement and maintain security (Kerberos, LDAP/AD, Sentry, etc.) Develop business relevant applications in Spark, Spark Streaming, Kafka using functional programming in Scala Implement statistical methods and machine learning algorithms to be executed in Spark applications Create run books for troubleshooting, cluster recovery and routine cluster maintenance Troubleshoot Hadoop related applications, components and infrastructure issues at large scale 3rd Level-Support (DevOps) for business critical applications Profile: degree in computer science, mathematics, business informatics or similar Deep expertise in distributed computing and the factors determining and affecting distributed system performance Experience with implementing Hadoop clusters in a large scale environment Excellent hands on working experience with Hadoop ecosystem for at least 2 years Strong expertise in functional programming, object oriented programming and scripting, i.e. in Scala, Java, Ruby, Groovy, Python, R Proficiency with IDEs (IntelliJ IDEA, Eclipse, etc.), build automation (Maven, etc.) and continuous integration tools (Jenkins, etc.) Strong Linux skills; hands on experience with enterprise level Linux deployments as well as shell scripting (bash, tcsh, zsh) Well versed in installing, upgrading & managing distributions of Hadoop (CDH5x), Cloudera Manager, MapR, etc. Hadoop cluster design, cluster configuration, server requirements, capacity scheduling, installation of services: name node, data node, zookeeper, job tracker, yarn, etc. If you feel you have the skills to do this job then waste no time in applying now as this is a superb opportunity at an internationally known company! !!!!!ONLY APPLICANTS WITH NECESSARY WORKING VISA FOR GERMANY WILL BE CONSIDERED!!!!! Call/Email Ali immediately on: / (0) (ext 2301) / for a more detailed conversation. Not for you? If you have a friend or colleague that may be suitable, then please pass on my details. Successful referrals will be rewarded with £250 shopping vouchers. Churchill Frank are the global leader in Big Data/Science recruitment specialising in placing Analytics professionals across the DACH region.

Employment Type: Permanent

Pay: 70,000 to 90,000 EUR (Euro)
Pay Period: Annual
Other Pay Info: €70000 - €90000 per annum + bonus and more...

Share
Post a Job