Cheat sheet of command to check internals of Glusterfs volume ?

How to to check the details of volume ?

[root@Node2 tmp]# gluster vol status RepVol1 detail
Status of volume: RepVol1
——————————————————————————
Brick                : Brick Node1:/Replicated/RepBrickNode1
Port                 : 49152
Online               : Y
Pid                  : 2877
File System          : xfs
Device               : /dev/mapper/FirstVG-ReplicatedLV1
Mount Options        : rw
Inode Size           : 512
Disk Space Free      : 731.7MB
Total Disk Space     : 1014.0MB
Inode Count          : 524288
Free Inodes          : 524238
——————————————————————————
Brick                : Brick Node2:/Replicated/RepBrickNode2
Port                 : 49156
Online               : Y
Pid                  : 2655
File System          : xfs
Device               : /dev/mapper/FirstVG-ReplicatedLV1
Mount Options        : rw
Inode Size           : 512
Disk Space Free      : 731.7MB
Total Disk Space     : 1014.0MB
Inode Count          : 524288
Free Inodes          : 524238

Above command will give the information about each brick of volume.

How to check the clients connected to volume ?

[root@Node2 tmp]# gluster vol status RepVol1 clients
Client connections for volume RepVol1
———————————————-
Brick : Node1:/Replicated/RepBrickNode1
Clients connected : 9
Hostname                                               BytesRead    BytesWritten
——–                                               ———    ————
192.168.111.129:1002                                        6852            6840
192.168.111.130:1012                                       11764           11308
192.168.111.129:1006                                        4212            3968
192.168.111.129:958                                         2240            1764
192.168.111.130:960                                         1200             800
192.168.111.131:970                                         1200             800
192.168.111.130:948                                         2236            1764
192.168.111.131:954                                         2240            1764
192.168.111.131:1017                                   262604980          671960
———————————————-
Brick : Node2:/Replicated/RepBrickNode2
Clients connected : 9
Hostname                                               BytesRead    BytesWritten
——–                                               ———    ————
192.168.111.130:1002                                       14720           16188
192.168.111.129:1011                                        4880            5308
192.168.111.129:955                                         1076             676
192.168.111.129:953                                         2116            1612
192.168.111.130:967                                         4212            3968
192.168.111.131:961                                         1200             800
192.168.111.130:943                                         2236            1764
192.168.111.131:953                                         2240            1764
192.168.111.131:1016                                   262607044          679020
———————————————-

How to check the memory statistics associated with memory ?

[root@Node2 tmp]# gluster vol status RepVol1 mem
Memory status for volume : RepVol1
———————————————-
Brick : Node1:/Replicated/RepBrickNode1
Mallinfo
——–
Arena    : 3031040
Ordblks  : 75
Smblks   : 1
Hblks    : 12
Hblkhd   : 16060416
Usmblks  : 0
Fsmblks  : 128
Uordblks : 2868960
Fordblks : 162080
Keepcost : 129360

Mempool Stats
————-
Name                            HotCount ColdCount PaddedSizeof AllocCount MaxAlloc   Misses Max-StdAlloc
—-                            ——– ——— ———— ———- ——– ——– ————
RepVol1-server:fd_t                    1      1023          108         98        3        0            0
RepVol1-server:dentry_t               11     16373           84         15       12        0            0
RepVol1-server:inode_t                13     16371          156        121       14        0            0
RepVol1-changelog:changelog_local_t         0        64          116          0        0        0            0
RepVol1-locks:pl_local_t               0        32          148        240        1        0            0
RepVol1-marker:marker_local_t          0       128          332         96        2        0            0
RepVol1-quota:quota_local_t            0        64          412          0        0        0            0
RepVol1-server:rpcsvc_request_t         0       512         2828       3018        7        0            0
glusterfs:struct saved_frame           0         8          124         15        3        0            0
glusterfs:struct rpc_req               0         8          588         15        3        0            0
glusterfs:rpcsvc_request_t             1         7         2828          6        1        0            0
glusterfs:log_buf_t                    0       256          140          1        1        0            0
glusterfs:data_t                     230     16153           52      13411      234        0            0
glusterfs:data_pair_t                202     16181           68       8668      206        0            0
glusterfs:dict_t                      49      4047          140       4907       49        0            0
glusterfs:call_stub_t                  0      1024         3756       2818        8        0            0
glusterfs:call_stack_t                 1      1023         1836       2799        8        0            0
glusterfs:call_frame_t                 0      4096          172      15851       36        0            0
———————————————-
Brick : Node2:/Replicated/RepBrickNode2
Mallinfo
——–
Arena    : 3031040
Ordblks  : 76
Smblks   : 1
Hblks    : 12
Hblkhd   : 16060416
Usmblks  : 0
Fsmblks  : 128
Uordblks : 2868240
Fordblks : 162800
Keepcost : 130128

Mempool Stats
————-
Name                            HotCount ColdCount PaddedSizeof AllocCount MaxAlloc   Misses Max-StdAlloc
—-                            ——– ——— ———— ———- ——– ——– ————
RepVol1-server:fd_t                    1      1023          108         97        3        0            0
RepVol1-server:dentry_t               11     16373           84         13       12        0            0
RepVol1-server:inode_t                13     16371          156        128       14        0            0
RepVol1-changelog:changelog_local_t         0        64          116          0        0        0            0
RepVol1-locks:pl_local_t               0        32          148        261        1        0            0
RepVol1-marker:marker_local_t          0       128          332         88        3        0            0
RepVol1-quota:quota_local_t            0        64          412          0        0        0            0
RepVol1-server:rpcsvc_request_t         0       512         2828       3021        6        0            0
glusterfs:struct saved_frame           0         8          124         12        3        0            0
glusterfs:struct rpc_req               0         8          588         12        3        0            0
glusterfs:rpcsvc_request_t             1         7         2828         13        1        0            0
glusterfs:log_buf_t                    0       256          140          1        1        0            0
glusterfs:data_t                     230     16153           52      13512      234        0            0
glusterfs:data_pair_t                202     16181           68       8717      206        0            0
glusterfs:dict_t                      49      4047          140       5025       50        0            0
glusterfs:call_stub_t                  0      1024         3756       2830        6        0            0
glusterfs:call_stack_t                 1      1023         1836       2815        6        0            0
glusterfs:call_frame_t                 0      4096          172      15884       30        0            0
———————————————-

How to check the inode(gfid) information of volume ?

[root@Node2 tmp]# gluster vol status RepVol1 inode
Inode tables for volume RepVol1
———————————————-
Brick : Node1:/Replicated/RepBrickNode1
Connection 1:
Active inodes:
GFID                                            Lookups            Ref   IA type
—-                                            ——-            —   ——-
39797711-69ef-4401-b291-d0887dd9d254                  1              1         R
00000000-0000-0000-0000-000000000001                  3           1887         D

LRU inodes:
GFID                                            Lookups            Ref   IA type
—-                                            ——-            —   ——-
1ca4894a-4f7a-4d53-b59a-9b7362c30a49                  8              0         R
923f7191-be9a-468b-be78-08291c33e73c                  8              0         R
ab82df2f-c662-43bb-a574-3358ce1ea493                  8              0         R
2374d8b8-adce-48e5-b084-59d127f33269                  8              0         R
7bb74b51-f0f1-448a-80fd-544e380dcfe4                  1              0         R
197415fa-0a44-42e0-a67e-6c6030232b02                  1              0         R
54f5417b-81ca-4232-a13a-ff117c21ab0c                  1              0         R
2d391b7b-d110-4966-9489-bb70370003d9                  1              0         R
f749c90a-59a5-48f1-b5ae-0823a9e5b434                  1              0         R
6f47a320-43e6-4547-a8a0-a5bbe22027d2                 19              0         R
e7249e99-9aec-4166-be1b-51d799e1206f                 31              0         D

How to check the call statistics of volume ?

[root@Node2 tmp]# gluster vol status RepVol1 callpool
Pending calls for volume RepVol1
———————————————-
Brick : Node1:/Replicated/RepBrickNode1
Pending calls: 1
Call Stack1
UID    : 0
GID    : 0
PID    : 0
Unique : 0
Frames : 1
Frame 1
Ref Count   = 0
Translator  = glusterfs
Completed   = No

———————————————-
Brick : Node2:/Replicated/RepBrickNode2
Pending calls: 1
Call Stack1
UID    : 0
GID    : 0
PID    : 0
Unique : 0
Frames : 1
Frame 1
Ref Count   = 0
Translator  = glusterfs
Completed   = No

———————————————-

How to check the status of file descriptor of volume ?

[root@Node2 tmp]# gluster vol status RepVol1 fd
FD tables for volume RepVol1
———————————————-
Brick : Node1:/Replicated/RepBrickNode1
———————————————-
Brick : Node2:/Replicated/RepBrickNode2
———————————————-

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s