Data Ingestion into Hadoop (ETL) and data processing using Pig, Hive and Spark

I have 9 years of experience in IT with 2 years in Hadoop technologies Hive,PIg,Sqoop,Spark,Map Reduce.I have worked in Hadoop projects and POCs with different source systems like mainframes ,SQL server

More than 15 years of engineering experience using Java for object architecture , design and programming (j2se/j2ee/Struts/Spring), designing highly-available, scalable , multi-tenant web, XML/SOAP/REST endpoints , services, and rich client applications, using JDBC/ORM or XML to interface to backing data stores. We massively worked on Big Data technologies. We worked on building generic and scalable solutions and products right from the scratch and was involved in every phase of SDLC like design, development, testing and deployment Technologies - Java, J2ee, Struts, Cassandra, HBase, Redis, ElasticSearch, Kafka, Spring Boot, Hibernate, AngularJS, Apache, ,Servlet, JSP, Javascript, HTML, Tomcat, Hadoop (HDFS , MR), Hive , Pig, RabbitMQ, Oracle9i ,MySQL, Jboss Application Server.

I have 4 year experience in Hadoop and have experience in end to end implementation of 4 hadoop project.

I have experience with hadoop environment for my master research.

Hello, Could you explain a bit more your project, in order that I can tell if I'm able to help or not? For example , what kind of dtaa do you have in your ETL? Wating for your reply, Thanks, Nicolas

hii we have a 11 year of experience in big data, hadoop,spark and many more. sound experience on data processing.

I have the required skills for this project. I am looking forward for this project.

Hi I have 3+ years of experience in dwh, python and informatica. Let me know the detail of the project.

I'm a big data hadoop | spark developer cum certified Instructor and have in total 3 years of experience have done many training projects which is similar to your project. so I guess I can easily do the following assignment.

Hi, I have the required experience and I can help you. Please contact me for more details. Regards, Mohammad Alaa

i have very good experience in dataware housing project. i am sure you will be satisfy with my work. also, i am comfortable with hadoop ecosystem.

I can do the processing part, pullling the data into hdfs and processing it using hive/spark or any hadoop technology of your choice. Let me know how i can help you with.

I just have done a similar project for which I took data from HIVE tables in SPARK( in spark datasets), implemented some transformation on that data and stored the data back into HDFS, data was partitioned in HIVE on arrival time so I was just processing incremental changes. I have a ready project I just need to understand your requirements, and complete your task.