Big Data Platform Engineer

We are looking for a full-time Big Data Platform Engineer who will participate in planning, design, development, testing and implementation of big data software projects - products and services.

The primary responsibility of the Big Data Platform Engineer will be:

• Design and lead development of Big Data solutions

• Solve complex problems on Big Data with innovative solutions

• Research software tools and technologies; recommend and champion usage

Job Description

• Develop and maintain internal big data services and tools

• Help building real time analytics system

• Collaborate cross-functionally with CRM & Marketing & Business Intelligence teams

• Develop ETL in distributed processing environment

• Contribute to the architecture of products and customer solutions to ensure the architecture employs maintainable, usable and flexible frameworks

• Design and implement scalability, resiliency, performance and security aspects of products and solutions using leading design practices

• Develop high quality, reusable software components, common services, templates and tools that form a framework which can be leveraged across the development team to accelerate the delivery of ASP one’s products and solutions

Desired Skills and ExperienceKnowledge and SkillsMust haves:

• Bachelor’s degree or above in Computer Science, Mathematics or related engineering field

• At least 3 years of big data software development experience of designing, developing, deploying, and maintaining

• At least 3 years of experience on Python/Scala/Java environment

• Experience with Hadoop components like HDFS, HBase, Solr, Hive, Pig, Spark, Kafka, Flume...

• Experience with other NoSQL solutions like mongodb, redis, couchbase...

• Experience with machine learning algorithms

• Experience with high-scale, distributed web service development(hands-on experience with RESTful web services)

• Excellent problem solving and critical thinking skills

• Excellent written and oral communication skills on English

Experience in:

• Enterprise Integration Patterns

• Agile methodologies

• Configuration management and build/release planning & management (ANT/Maven/SBT/Gradle/Jenkins)

• Distributed Caching

Nice to haves:

•    PhD or Master’s degree
•    Prior experience in a growth company
•    Involvement and contribution to Open Source projects
•    Experience in IaaS, PaaS or SaaS cloud solutions