π Hadoop eco system ꡬμΆμ€μ΄μ λΆ
π λ°μ΄ν° μ μ¬ λ° μ²λ¦¬λ₯Ό μν΄ Hiveλ₯Ό μ¬μ©νμλ λΆ
tez engine κΈ°λ°μ Hive ꡬλ μ, μλ¬ λ°μ νμΈ
Exception in thread "main" java.lang.RuntimeException:java.io.IOException: Previous writer likely failed to write hdfs://mycluster/user/root/.hiveJars/hive-exec-3.1.2-50b0545693ae9392559584116a172ee32922e57ae9ea0eb7dc120290c217c2d5.jar. Failing because I am unlikely to write too.
~
Caused by: java.io.IOException: Previous writer likely failed to write hdfs://mycluster/user/root/.hiveJars/hive-exec-3.1.2-50b0545693ae9392559584116a172ee32922e57ae9ea0eb7dc120290c217c2d5.jar. Failing because I am unlikely to write too.
~
Q: Hive ꡬλ μ, μκΈ° μ€λ₯κ° λ°μν΄μπ¦π¦
A: λ¨Όμ hive-site.xmlμμ hive.exec.scratchdirμ κ°μ νμΈνμΈμ.
ν΄λΉ κ°μ μ΅μλ¨(루νΈ) λλ ν°λ¦¬λ₯Ό νμΈν ν,
Hadoop NN(active)μ ν°λ―Έλλ‘ μ΄λν©λλ€π¨
ν΄λΉ ν°λ―Έλμμ
hdfs dfs -chmod -R 777 /[μκΈ°μμ νμΈν λλ ν°λ¦¬λͺ
]
μ μ
λ ₯νμ¬ κΆνμ λ³κ²½ν΄μ€λλ€.
λ€μ hive μλ² κ΅¬λμ νλ©΄ μ μμ μΌλ‘ ꡬλλλ κ²μ νμΈν μ μμ΅λλ€.