About Us > Careers > Big Data Engineer

Big Data Engineer

 Pune India     Design: Big Data Engineer       Full-time

Company Overview

HiLabs (www.hilabs.com) is a health data analytics company with product offering to healthcare payers and providers in the United States of America. Its clients range from fortune 50 companies to government entities. The company has a strong VC backing, excellent management team from best Business schools and brilliant data engineers from top engineering colleges of the world.

Job Responsibilities

  • Work in a cross-functional environment to architect, design and develop new functions in HiLabs product line.

  • Conduct feasibility analysis, produce functional and design specifications of proposed new features.

  • Troubleshoot complex issues discovered in-house as well as in customer environments.

  • Improve codebase, bring in latest technologies, re-architect modules to increase the throughput and performance.

  • Develop the software or program in accordance with the High Level and Low Level design to fulfill the project delivery

  • Adhere to enterprise standards guidelines, best practices and processes while the program or code being developed

  • Work with SME/Business Analyst / Technical Manager / Architect and create required test data for Testing the code developed

  • Create and Execute the Unit Test Cases, Integration Tests, follow coding best practices and proactively work towards resolving all the issues before handing over the code for code review

  • Conduct initial peer code reviews before handing over the code to Solutions Architect for code review

  • Proactively communicate all the risks/issues and any road blockers to Technical Lead / Project Manager

  • Create the required project artifacts like data flow diagrams / work flow diagrams, use case diagram, detail design covering enterprise features like Monitoring, logging, security, test automation, deployment automation (CI/CD) during development

  • Create the required artifacts for migration of code to QA and Production environment

  • Work with Technical leads and architects during production deployment

  • Work closely with the Application Support Team during the transition of the application

  • Provide L2 / L3 / L4 support to the Application Support team during warranty period and facilitate in resolving the production issues within defined SLA

  • Mentor junior engineers in software development, technology and processes.


Desired Profile

  • BE / B.Tech / ME / M.Tech in CS or other branches of engineering

  • Solid CS fundamentals including data structure and algorithm design, and creation of architecture and design specifications.

  • Working knowledge and experience of Big Data / Hadoop tools and technologies like Hive, UDF, HDFS, Spark, SparkML, SparkSQL, data ingestions and visualization.

  • Database development experience with a solid understanding of core database concepts, relational database design (nice to have knowledge on one of the NoSQL DBs like Mongo/Cassandra/HBase etc) .

  • Expert level knowledge of SQL and scripting preferably UNIX shell scripting, Perl scripting

  • Good understanding of Cloudera platform administration, Apache hadoop/spark ecosystem, distributed computing, and integration, etc.

  • R&D contributions and production deployments of large backend systems, supporting big data use cases.

  • Knowledge of designing and implementing data processing pipelines with a combination of the following technologies: Hadoop, Map Reduce, YARN, Spark, Hive, Kafka, Avro, Parquet, SQL and NoSQL data warehouses.

  • Experience in implementation of professional software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management, documentation, build processes, automated testing, and operations.

  • Experience in defining big data solution architectures and component designs, exploring technical feasibility trade-offs, creating POCs using new technologies, and productizing the best solutions in line with business requirements.

  • Passion for developing and maintaining a high quality code and test base, and enabling contributions from engineers across the team.

  • Ability to handle multiple competing priorities with good time management and a dedication to doing what it takes to get the work done right.

  • Ability to achieve stretch goals in a very innovative and fast paced environment.

  • Ability to learn new technologies quickly and independently.

  • Excellent verbal and written communication skills, especially in technical communications.

  • Strong inter-personal skills and a desire to work collaboratively.

  • Excellent understanding of all aspects of the Software Development Lifecycle.

  • Experience in Java will be an added advantage

  • Knowledge of object oriented programming concepts is a must

Want to apply?

Send us your updated resume and tell us why you will be a good fit for the role in 150-200 words. Email us at careers@hilabs.com with the subject line " Applying for Big Data Engineer "

Disclaimer:- HiLabs is committed to ensure safety for all. As the COVID -19 Pandemic continues, our hiring and on-boarding processes are being conducted remotely through virtual meetings until further notice.

About HiLabs, A cohort of experienced Engineers, Data Scientists and Physicians.

Subscribe to our newsletter and stay up to date with the latest news and deals!