Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some nodes' data gets bucketed into "Unknown" disk #3

Open
Tagar opened this issue Apr 11, 2018 · 2 comments
Open

Some nodes' data gets bucketed into "Unknown" disk #3

Tagar opened this issue Apr 11, 2018 · 2 comments

Comments

@Tagar
Copy link

Tagar commented Apr 11, 2018

 === Distribution across nodes and disks ===

DiskId                   0 0 0 0 0 0 0 0 0 0 1 1
                         0 1 2 3 4 5 6 7 8 9 0 1 Unknown   Count     Average
Host
pc1udatahad15.abacus-u...= = - + = - = = = =     0         4990      499
pc1udatahad12.abacus-u...= = = = = = = = = =     0         6000      600
pc1udatahad07.abacus-u...= = + = = - + - = =     0         3597      359
pc1udatahad16.abacus-u...0 0 0 0 0 0 0 0 0 0     19489     19489     0
pc1udatahad11.abacus-u...= = = = = = = = = =     0         6919      691
pc1udatahad09.abacus-u...0 0 0 0 0 0 0 0 0 0 0 0 9131      9131      0
pc1udatahad17.abacus-u...0 0 0 0 0 0 0 0 0 0     6529      6529      0
pc1udatahad10.abacus-u...= = = + = = = - - = = = 0         8337      694
pc1udatahad13.abacus-u...= = = = = = = = = =     0         5947      594
pc1udatahad14.abacus-u...= = = = = = = = = =     0         6424      642
pc1udatahad08.abacus-u...+ - + - - - = + = +     0         2637      263

Notice nodes 16, 09, 17 show zeros in all disks and actual data gets dumped into "Unknown" column.. anyone knows why that is?

@dlanza1
Copy link
Contributor

dlanza1 commented Apr 12, 2018

How you tried restarting them? are they running the same version of HDFS?

@Tagar
Copy link
Author

Tagar commented Apr 12, 2018

Yes, same version. We run Cloudera distribution of Hadoop, deployed through parcels so they're 100% same version. They work correctly, no issues. This is part of a production cluster, we know they work correctly and can't restart them easily - it has to be scheduled. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants