Show Headings (Column Names) in spark-sql CLI Result

Raymond Tang Raymond Tang 0 1499 0.91 index 12/28/2020

In Spark-SQL CLI tool, the result print will omit headings (column names) by default. To display columns, we need to update Spark settingĀ spark.hadoop.hive.cli.print.header.

Update Spark defaults file

To make the changes for all spark-sql sessions, edit file $SPARK_HOME/conf/spark-defaults.conf.

Add the following line into the file:

spark.hadoop.hive.cli.print.header true

Pass config value when starting session

If you only want to make this config effective for the session, start spark-sql CLI with the following argument:

spark-sql --conf "spark.hadoop.hive.cli.print.header=true"
spark spark-sql

Join the Discussion

View or add your thoughts below

Comments