Verified Job
IT / Software / Data Analyst
Offshore Pyspark Developer
IT / Software / Data Analyst
#341599
Remote / WFH
Job Description
Job openings for offshore pyspark developer in chennai
Design and development of data ingestion pipelines (Databricks background preferred).
Performance tune and optimize the databricks jobs
Evaluated new features and refractors existing code
Mentor junior developers and makes sure all patterns are documented
Perform data migration and conversion activities.
Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.
Maintain and support the application.
Must be willing to flex work hours accordingly to support application launches and manage production outages if necessary
Ensures to understand the requirements thoroughly and in detail and identify gaps in requirements
Ensures that detailed unit testing is done, handles negative scenarios and document the same
Work with QA and automation team.
Works on best practices and documenting the process
code merges and releases (Bitbucket)
Works with architect and manager on designs and best practices
Good data analysis skills
Experience
4 - 10 Years
Salary
5 Lac To 20 Lac P.A.
Industry
IT Software - Application Programming / Maintenance
Qualification
B.C.A, B.Sc, B.Tech/B.E, M.C.A, M.Sc, M.Tech
Key Skills
SCALA
Pyspark
SQL
Big Data tool
Linux
Python
Kafka
About Company
Contact Person
Mr.S.Buvanesh
Address
Regus Business centre Plaza Pvt Ltd,RMZ Millenia Business Park,Level 6, Phase II, Campus 4B,Unit 602A, No. 143, Dr. M.G.R Road,Kandanchavady
Mobile
+361612870
Email ID
admin@bsrisolutions.com
Design and development of data ingestion pipelines (Databricks background preferred).
Performance tune and optimize the databricks jobs
Evaluated new features and refractors existing code
Mentor junior developers and makes sure all patterns are documented
Perform data migration and conversion activities.
Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.
Maintain and support the application.
Must be willing to flex work hours accordingly to support application launches and manage production outages if necessary
Ensures to understand the requirements thoroughly and in detail and identify gaps in requirements
Ensures that detailed unit testing is done, handles negative scenarios and document the same
Work with QA and automation team.
Works on best practices and documenting the process
code merges and releases (Bitbucket)
Works with architect and manager on designs and best practices
Good data analysis skills
Experience
4 - 10 Years
Salary
5 Lac To 20 Lac P.A.
Industry
IT Software - Application Programming / Maintenance
Qualification
B.C.A, B.Sc, B.Tech/B.E, M.C.A, M.Sc, M.Tech
Key Skills
SCALA
Pyspark
SQL
Big Data tool
Linux
Python
Kafka
About Company
Contact Person
Mr.S.Buvanesh
Address
Regus Business centre Plaza Pvt Ltd,RMZ Millenia Business Park,Level 6, Phase II, Campus 4B,Unit 602A, No. 143, Dr. M.G.R Road,Kandanchavady
Mobile
+361612870
Email ID
admin@bsrisolutions.com
