Cassandra Bulk Load - NoHostAvailableException

We perform hourly aggregations using Spark SQL and Cassandra on huge data. We developed a Java client that runs every hour to perform aggregations using Spark SQL. For historical loads. When we run this program for 10 days (240 hours) of data, after processing about 100 hours, Cassandra fails with below error:

com.datastax.driver.core.exceptions.NoHostAvailableException: All host (s) tried for the request failed (host was not verified)

what makes Cassandra fail?

+3


source to share


1 answer


This is allowed after setting higher values ​​for "spark.cassandra.read.timeout_ms"

and"spark.cassandra.connection.timeout_ms"



+2


source







All Articles