Thursday, 15 July 2010

java - Difference between hive thrift server from hive and spark distributions -


What is the difference between the ongoing hive server using any of the following two commands: -

  1. Honeycomb - hiveserver2
  2. spark / sbin $ ./start-thrutherver.sh
from hive Running downstream server

Do they listen on different ports?

< Div> text ">

Hiveserver2 is a hive SQL engine that can use ground reduction, spark or tee as the execution engine, creates a hive execution plan and then invites the execution engine to run the query. Optimization is done by hive.

I am a huge spark user, but the hive was available to run the adhock query through color. After the inspection I can see that Hive 1.2.1 supports SPARC 1.4.1 as the performance engine. Hive 2 has the dependency of SPARC 1.5, but I have not tried to run it with 1.5 or 1.6 .

Spark Rivet Server can replace hive server 2, and actually uses spark to run the query execution plan (which may or may be greater than the hive), but You have other sparks Roton also like access to the RDD, text files and so on. Of course, you can run saving server with the latest version of sparks.


No comments:

Post a Comment