Big Data Platform Engineer

We are looking for a fulltime Big Data Platform Engineer who will participate in planning, design, development, testing and implementation of big data software projects products and services. The primary responsibility of the Big Data Platform Engineer will be:

•  Design and lead development of Big Data solutions
•  Solve complex problems on Big Data with innovative solutions
•  Research software tools and technologies? recommend and champion usage

Job Description

•  Develop and maintain internal big data services and tools
•  Help building real time analytics system
•  Collaborate crossfunctionally with CRM & Marketing & Business Intelligence teams
•  Develop ETL in distributed processing environment
•  Contribute to the architecture of products and customer solutions to ensure the architecture employs maintainable, usable and  flexible frameworks
•  Design and implement scalability, resiliency, performance and security aspects of products and solutions using leading design  practices
•  Develop high quality, reusable software components, common services, templates and tools that form a framework which can  be leveraged across the development team to accelerate the delivery of ASP one’s products and solutions

Desired Skills and Experience  

Knowledge and Skills

Must haves:

•  Bachelor’s degree or above in Computer Science, Mathematics or related engineering field
•  At least 3 years of big data software development experience of designing, developing, deploying, and maintaining
•  At least 3 years of experience on Python/Scala/Java environment
•  Experience with Hadoop components like HDFS, HBase, Solr, Hive, Pig, Spark, Kafka, Flume...
•  Experience with other NoSQL solutions like mongodb, redis, couchbase...
•  Experience with machine learning algorithms
•  Experience with highscale, distributed web service development(handson experience with RESTful web services)
•  Excellent problem solving and critical thinking skills
•  Excellent written and oral communication skills on English

Experience in:

•  Enterprise Integration Patterns
•  Agile methodologies
•  Configuration management and build/release planning & management
   (ANT/Maven/SBT/Gradle/Jenkins)
• Nice to haves:
•  Distributed Caching                                                                                                                                                
•  PhD or Master’s degree
•  Prior experience in a growth company
•  Involvement and contribution to Open Source projects
•  Experience in IaaS, PaaS or SaaS cloud solutions