Phoenix JDBC driver is too slow
I am using phoenix driver 4.0 version to query the database. I have also tried setting hbase.client.scanner.caching to 1000 and 10000 In all cases it takes 3 minutes to iterate over 10000 lines. I am not adding code inside the iteration loop. I have to scan over 1L of records, so it takes over half an hour.
What is the reason for this.
long count = 0;
while (rs.next())
{
if (count % 1000 == 0)
{
log.info("Count == " + count);
}
count++;
}
+3
source to share
1 answer
I think hasoop and its component are good at group function and hash propagates the entry using rowkey to find the entry quickly. But not very good iterative, you start recording 10,000, it can cost the same as 100,000 or even 1,000,000. I hope you can understand what I mean through my poor English. :)
0
source to share