Data Engineer Python and Spark AssociateAVP

Position Overview Deutsche Bank Job Description - Data Engineer - Python and Spark Corp Title: Associate/AVP Functional Title : Developer Work Location: Pune, India Division/Department: Infrastructure/GCIO/Platform Technology Reports to: Big Data Module AVP About Deutsche Bank & Group Technology and Operations (GTO) : Deutsche Bank AG is a German global banking and financial services company with its headquarters in the Deutsche Bank Twin Towers in Frankfurt, Germany. It employs more than 80,000 people in over 70 countries, and has a large presence in Europe, the Americas, Asia-Pacific and the emerging markets. Role Description - Summary: Part of the Group Chief Information Office, the Enterprise Analytics Platform (EAP) is a shared technology service to provide advanced data management and data analytics capabilities in a cost and operationally efficient manner. By combining a number of Big Data and NoSQL technologies, and an integrated set of best of breed data science tools, the EAP is able to support the creation of unique data insights (e.g. predictive analytics) at greatly reduced cost and improved time to market when compared to traditional data mining techniques. The EAP is built on Apache Hadoop - one of the leading Big Data technologies The successful candidate would play the role of Data Engineer in the Enterprise Analytics Platform. Responsibilities/Tasks: Evaluate various tools/technologies by performing PoCs on them Engineer new tools and technologies into the EAP stack Benchmark tools/technologies and publish the benchmarks Assist users in remediating performance issues observed in the Big Data tools and technologies Develop automation scripts in Python/Scala and Apache Spark Develop performance test suites for various tools and technologies Design, develop and configure Production level Secure Hadoop based data ingestion and analytics services Ensure delivery in adherence to appropriate controls, standards and methods as per DB IT policies Performance tuning & optimization of ETL and analytics frameworks Contributing toward Continuous improvement and R&D Supporting projects and platform users with innovative solution development Experience/Exposure: Total Handson experience of 10-16 years for AVP , 5-10 years for Associate 3-7 years of experience in Python 2-3 years of experience in Apache Spark, Hive/Impala/Kafka etc. Working knowledge of Spark RDD, Data Frame API, Data set API, Data Source API & Spark SQL Hands on knowledge of developing Python consumers & producers using Kafka-Python client Highly Desirable - Experience in REST services and Big Data technologies such as Oozie, Sqoop, and other bigdata ETL tools Education/Certification: Educated to Bachelors degree level or above (or overseas equivalent) Candidate will be: A creative technologist passionate about data and information Logical, innovative, and should be able to articulate and should be able to work directly with technical and non-technical stakeholders Experienced in commercial enterprise grade software and platform delivery Organized and driven to continuously improve the platform and themselves Diligent, methodical and able to constructively critique and improve designs and methods Our values define the working environment we strive to create - diverse, supportive and welcoming of different views. We embrace a culture reflecting a variety of perspectives, insights and backgrounds to drive innovation. We build talented and diverse teams to drive business results and encourage our people to develop to their full potential. Talk to us about flexible work arrangements and other initiatives we offer. We promote good working relationships and encourage high standards of conduct and work performance. We welcome applications from talented people from all cultures, countries, races, genders, ****** orientations, disabilities, beliefs and generations and are committed to providing a working environment free from harassment, discrimination and retaliation. Click to find out more about diversity and inclusion at Deutsche Bank