Spart Developer Needed

Java/J2EE/Struts/Spring/JPA Scala/Python (pyspark, pykafka)/Shell Hadoop/Spark/Kafka/Cassandra/Hive/HBase ELK

I am a data scientist and have experience with Big Data technologies like Spark and Hadoop. I also have experience with machine learning and statistical analysis of data using R and Python. Please provide more details about your project. I would like to do it.

I can help you do your spark work. Relevant Skills and Experience Spark , scala

• Having 5 Years of total experience in Software Design and Development. • Having workingexperience in Hadoop Ecosystem like Apache Storm, Flume, Kafka, Orient DB, Elastic Search,HDFS, Mapreduce, HBase, Hive, Sqoop etc. • Having hands-on experience with Spark with Machine learning(ML). • Having working experience in Core Java, J2EE, JSP, Servlet, Struts 1.x, Spring MVC, Hibernate Framework and JDBC. • Experience in Educational, E-commerce and Banking Domains. • Hands on experience in developing end-to-end solution of software products/Web Applications from requirement analysis to system study, designing, coding, unit testing, de-bugging, documentation and implementation.

A proposal has not yet been provided

•Having 3+ years of Hadoop Development - managing and tuning Hadoop cluster and its ecosystem components ( Hive, Pig, Spark, HDFS, Sqoop, Flume, Zookeeper, Kafka, Yarn and Oozie). •Excellent knowledge on Hadoop ecosystems such as HDFS, ResourceManager, NodeManager, Name Node, Data Node and Map Reduce programming paradigm. •Expertise in SparkSQL and knowledge on Spark Architecture. •Good working experience on Spark using Scala to compare the performance of Spark with Hive and SQL. •Extensive Experience in Setting Hadoop Cluster. Good working knowledge with Hive, Pig and MapReduce. •Experience in Oozie and workflow scheduler to manage Hadoop jobs by Direct Acyclic Graph (DAG) of actions with control flows. •Good understanding of NoSQL databases and hands on work experience in writing applications on NoSQL databases like HBase and MongoDB. •Strong SQL and database knowledge.